Testotron can automatically test basic functions of common servers, so you can get an alert when some piece of your configuration stops working.