Hypothetically, what is wrong with just storing my keys on a thumb drive with Electrum saved on it.

Then keeping that thumb drive stored separated from any computer. My friend asked me and I don't have a good answer.