People are way to paranoid about this stuff. The possibility that somebody breaks in and steals/opens your safe is very very very small. We don’t think that, because we see it on TV all the time, but that is not real life 😊
So if you don’t brag about how much crypto you have, it should be totally fine.
As been said by someone else already, if your seed phrase is in there, it doesn’t matter if the ledger is there too. The seed phrase would be enough for a thief
Did you give away information about your keys, or signed some strange contract lately?