I have SAM configured to monitor volume space for all of our servers. Yesterday, I found that one of our servers had zero disk space left, yet we were never alerted. We have received disk space alerts for some servers so I know the alert is active. As a test, I went in now and set very low volume space thresholds for two of our servers - one Linux and one Windows - but I still have not received any alert about it. What could be the problem?
I attached a picture of the alert settings. Please note we have two custom properties - PercentDisk_Marker set at 1%, and DiskUsage_Marker set at 1000 GB. Obviously, these thresholds should absolutely set off alerts on any normal server, yet it doesn't.
Any help is appreciated!
UPDATE: I went ahead and did away with the custom properties to test this issue and instead hardcoded values in the trigger conditions. If more than 1% of disk space is being used, the alert should go off. However, this one particular server is never alerted on. I can go into its node details page and pull all stats normally. I see that it should be triggering the alert, yet it isn't. What could be the reason no alerts are sent even though the stats SAM displays all qualify for triggering the alert?