How can I stop NetworkManager from continuously asking for the wireless password when trying to reconnect after the connection is temporarily dropped?

Unlike this post, this happens for me without suspending. My wireless WPA2 connection might drop a couple times, and NetworkManager will automatically reconnect. However, eventually NetworkManager will start prompting for the password, which is already filled in. Clicking Show password confirms it's already the correct password, and clicking Connect without changing anything also successfully connects.

Why is it doing this, and how do I stop it?