How does a cold wallet pin not compromise security?

If someone gets my Trezor and “guesses” my pin, would that not make it way easier to crack?

The passphrase is basically unhackable, but a short device PIN number seems easier to hack. And as far as I know all you need is the cold wallet, a computer, and the pin to make a transfer.

I’m not a techie, so maybe this is dumb. Just want some affirmation that should something happen to my cold wallet, my funds can’t be easily accessed.