============================= test session starts ============================== platform linux -- Python 3.9.21, pytest-6.2.5, py-1.11.0, pluggy-0.13.1 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/auto_parallel, configfile: ../../../../../../sault/virtual_test/virtualenv_002/sault/config/pytest.ini plugins: forked-1.6.0, hydra-core-1.3.2, xdist-1.32.0, anyio-4.9.0 collected 1 item test_cross_cluster.py F =================================== FAILURES =================================== ___________________________ test_cross_cluster_2_az ____________________________ @arg_mark(plat_marks=["platform_ascend910b"], level_mark="level1", card_mark="allcards", essential_mark="unessential") def test_cross_cluster_2_az(): ''' Feature: test cross cluster between 2 az Description: Test CCOOL communication library in cross 2az scenarios. Expectation: Run success, all CCOOL communication operators in all workers pass the test. ''' result, msg = msrun_cross_cluster(num_cluster=2, rank_size=8) > assert result, msg E AssertionError: test some cross cluster communication operators failed, please check the ms_run log E assert False test_cross_cluster.py:70: AssertionError =========================== short test summary info ============================ FAILED test_cross_cluster.py::test_cross_cluster_2_az - AssertionError: test ... ======================== 1 failed in 212.79s (0:03:32) =========================