Diff Coverage

Total: 2 lines
Missing: 1 line
Coverage: 50%

Source File	Diff Coverage (%)	Missing Lines
hyper_parallel/distributed/context_parallel/wrappers.py	50.0%	536

hyper_parallel/distributed/context_parallel/wrappers.py


        def cp_aware_sdpa(q: Any, k: Any, v: Any, **kw: Any) -> Any:
            """CP-aware SDPA replacement: all-gather K/V plus the D-04 mask."""
            fired["hit"] = True
            return _cp_sdpa_call(orig_sdpa, cp_mesh, q, k, v, kw)

        F.scaled_dot_product_attention = cp_aware_sdpa
        try:
            out = original_forward(hidden_states, *args, **kwargs)