Dynamic matrix sorting

Trying to build a matrix visual with:

- Columns: Attribute, Quarter

- Values: Total Value

- Rows: category dimension (i.e. product, channel)

I’ve created disconnected slicers for Attribute and Quarter so that I can sort by total value for any combination of those two categories. I’ve tried a Sort Measure to drive the sorting, and it works for sorting the rows correctly but Power BI requires it to be in the visual. I don’t want it to display the Sort Measure, and only want to see Total Value. I’ve also tried embedding the sort logic inside a measure for Toal Value, but then only the selected quarter and attribute show, albeit sorted correctly.

Is there a clean way to dynamically sort matrix rows? Can be based on the disconnected slicers selection, just want all Attributes/Quarters visible without also displaying another measure. Or is the only way to achieve this to hide the sort measure by formatting quirks?