{"id":3025,"date":"2011-07-12T14:22:13","date_gmt":"2011-07-12T12:22:13","guid":{"rendered":"https:\/\/ingmarverheij.com\/2011\/07\/failed-heartbeat-unnoticed-in-distributed-application\/"},"modified":"2011-07-12T14:22:13","modified_gmt":"2011-07-12T12:22:13","slug":"failed-heartbeat-unnoticed-in-distributed-application","status":"publish","type":"post","link":"https:\/\/ingmarverheij.com\/en\/failed-heartbeat-unnoticed-in-distributed-application\/","title":{"rendered":"Failed heartbeat unnoticed in Distributed Application"},"content":{"rendered":"

\"Server<\/p>\n

System Center Operations Manager (SCOM) monitors the health of systems with an agent. One of the most basic checks that is executed is a health check<\/strong> of the agent itself. One of the checks is a heartbeat<\/strong> between the agent and the RMS (Root Management Server). If the heartbeat is lost for three times (configurable), the agent is considered unavailable<\/strong>.\"Health<\/a><\/p>\n

An alert<\/strong> is generated and (if configured) a notification is send to inform the administrator that there is a problem.<\/p>\n

But if a Distributed Application<\/a> is configured to monitor a chain<\/strong> of components, this failure remains unnoticed. <\/p>\n

\"Node<\/a><\/p>\n

Nodes that are unmonitored are grey<\/strong> and appear to be \u2018Healthy’<\/strong>, which is strange for a node who\u2019s heartbeat haven\u2019t reported for quite some time.<\/p>\n

<\/p>\n

Unnoticed heartbeat failure<\/h4>\n

Operations Manager assumes that if a node is unavailable<\/strong> because the heartbeat<\/strong> is lost, no child<\/strong> objects should be monitored. This is good to prevent<\/strong> alerts of child objects which are probably as unavailable as the parent, but sets the whole node in an  \u2018unmonitored\u2019<\/strong> state.  <\/p>\n

\"Distributed<\/a><\/p>\n

The effect of putting a node in an ‘unmonitored<\/strong> state\u2019 is that a parent node in a distributed application, containing one or more agents, doesn\u2019t<\/strong> check the health of the machine. So, in other words, if the heartbeat is lost the parent nodes still reports it to be Okay<\/strong>.\"Distributed<\/a><\/p>\n

To prevent<\/strong> a parent node (containing one or more agents) to stop monitoring the health child nodes when they are unmonitored an override<\/strong> can be configured. With the override the state of an unmonitored node can be configured<\/strong> to result in a warning<\/strong> or an error<\/strong>.<\/p>\n

 <\/h4>\n

Configure override<\/h4>\n

The override should be configured in the node that contains the agents. As an example I\u2019ve created a Distributed Application with the name \u2018Test\u2019 that contains a node \u2018Application Servers\u2019. This node contains two agents : VCTX101 and VCTX110. <\/p>\n

\"Distributed<\/a><\/p>\n

Select the node and click \u2018Configure Health Rollup\u2019<\/strong>, here you can configure overrides<\/strong> for the node.<\/p>\n

On the bottom you will an override for the monitor \u2018Monitoring unavailable\u2019. The default<\/strong> option is \u2018Monitoring Unavailable\u2019 and would prevent<\/strong> an unmonitored node to affect the state of the node. By enabling<\/strong> an override and setting the value to \u2018Rollup monitoring unavailable to error\u2019<\/strong> an unmonitored node will place the node in an error<\/strong> state<\/strong>.<\/p>\n

 <\/p>\n

\"Override<\/a><\/p>\n

\"Override<\/a><\/p>","protected":false},"excerpt":{"rendered":"

System Center Operations Manager (SCOM) monitors the health of systems with an agent. One of the most basic checks that is executed is a health check of the agent itself. One of the checks is a heartbeat between the agent and the RMS (Root Management Server). If the heartbeat is lost for three times (configurable), […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[309],"tags":[319,360,361,235],"class_list":["post-3025","post","type-post","status-publish","format-standard","hentry","category-monitoring-2","tag-distributed-application","tag-heartbeat","tag-override","tag-scom"],"_links":{"self":[{"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/posts\/3025","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/comments?post=3025"}],"version-history":[{"count":0,"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/posts\/3025\/revisions"}],"wp:attachment":[{"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/media?parent=3025"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/categories?post=3025"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ingmarverheij.com\/en\/wp-json\/wp\/v2\/tags?post=3025"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}