Fixed
Details
Assignee
Jesse WhiteJesse WhiteReporter
Jesse WhiteJesse WhiteComponents
Sprint
NoneFix versions
Affects versions
Priority
Major
Details
Details
Assignee
Jesse White
Jesse WhiteReporter
Jesse White
Jesse WhiteComponents
Sprint
None
Fix versions
Affects versions
Priority
PagerDuty
PagerDuty
PagerDuty
Created March 19, 2019 at 2:41 PM
Updated April 25, 2019 at 1:57 PM
Resolved March 20, 2019 at 7:49 PM
While investigating a system hitting OOM errors:
we found that the heap was filled with SNMP results:
Investigating the heap dump further we found that most of these results were duplicates.
Looking at the SNMP traffic on the host, we found a large number of request/response packets with the following VBs:
In this case, the agent is responding with OIDs that are equal to the requested OIDs, rather than successors of the requested OIDs.
Our SNMP tracking code does not account for this and continues to request for OIDs following the last ones received, which leads to an infinite loop.
Everytime we receive a response, the results get added to memory, which leads to the observed problems.