WordPress stuck in maintenance mode

Problem: You are using Wordpress' great feature of automatic theme or plugin updates, but the AJAX throbber doesn't stop moving - your site seems to be stuck. You hit the reload button of your browser and this is what you get: "Briefly unavailable for scheduled maintenance. Check back in a minute." Solution: Open your (S)FTP program ...