If you buy physical gold where do you keep it? At home? Do you think that's safe?

The gold and silver you have in the brokerage account is outside your control. Ask them to send you the gold and see what happens. Any money, gold or anything else left with a broker is not yours and you will need their permission to withdraw or sell. Read the T&Cs.

Besides, gold gets rehypothecated 100 to 1 so your paper gold will be worthless when SHTF.

Nothing is truly yours unless you keep custody of the asset. Bitcoin is the only asset that allows that in a secure way