Remember Mute setting on exit?

I wonder if it could be a good idea that the mute setting is remembered on exit? Personally I would appreciate that the audio status is remembered, although I do see that there may be arguments against.