How is the size of BTC segwit blocks passing 1MB an acceptable burden for nodes to process without harming decentralization?

Nodes have to keep data processing and bandwidth requirements low according to small blockers so increasing the legacy blocksize past 1MB is unacceptable.

Segwit nodes have to have processing power and bandwidth to handle blocks of up to 4MB in weight. That data is just as burdensome to process as a 4MB legacy block.

Nodes can't process 4MB legacy blocks, but they can process 4MB segwit blocks?

I feel like I'm missing something because I can't be the only person who has thought of this if this is a relevant consideration.