Are hardware wallets truly safe if they're plugged into a computer?

If your PC is internet connected, and you connect your hardware wallet to it through USB or whatever, then doesn't that immediately put your wallet at risk?