Can we separate the blocksize ‘debate’ from a SegWit upgrade?

Some of the benefits of SegWit include:

• Malleability Fixes.
• Linear scaling of sighash operations.
• Signing of input values.
• Increased security for multisig via pay-to-script-hash (P2SH).
• Script versioning.
• Reducing UTXO growth.
• Efficiency gains when not verifying signatures.

Regardless of your position on block size surely there would be unanimous support for these features/fixes/improvements?

Can we change the narrative going forward to unite all bitcoiners on this as a separate technical issue, and debate a block size/hardfork on its own merits?