I hope for normal music listening, you are using WASAPI Exclusive or ASIO in which case, those settings make no difference.
Otherwise, yes, 44.1 kHz is the right sample rate as that is most of the content you play. I would also select 24 bit/32 bit mode as that doesn't require conversion back to 16 bits.