Good point,
Good point, "Off the shelf USB power packs use a switching regulator to make 5V from the battery voltage", which could reintroduce noise that you were trying to reduce. You would need the battery directly connected to a linear power supply and bypass the switching regulator.