In diagnosing another problem, I found these logs in the poller.log file:
java.lang.Exception: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutDiscards.jrb: 1422565840:0 at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:572) ~[opennms-rrd-api-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy.processPendingOperations(QueuingRrdStrategy.java:1150) [opennms-rrd-api-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy.run(QueuingRrdStrategy.java:1105) [opennms-rrd-api-15.0.0.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75] Caused by: org.jrobin.core.RrdException: Bad sample timestamp 1422565840. Last update time was 1422565840, at least one second step is required at org.jrobin.core.RrdDb.store(RrdDb.java:593) ~[jrobin-1.6.0.jar:1.6.0] at org.jrobin.core.Sample.update(Sample.java:221) ~[jrobin-1.6.0.jar:1.6.0] at org.jrobin.core.Sample.setAndUpdate(Sample.java:243) ~[jrobin-1.6.0.jar:1.6.0] at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:237) ~[opennms-rrd-jrobin-15.0.0.jar:?] at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:72) ~[opennms-rrd-jrobin-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:570) ~[opennms-rrd-api-15.0.0.jar:?] ... 3 more 2015-01-29 16:10:39,710 DEBUG [QueuingRrdStrategy-1] O.Queued: Error updating file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutOctets.jrb: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutOctets.jrb: 1422565840:0 java.lang.Exception: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutOctets.jrb: 1422565840:0 at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:572) ~[opennms-rrd-api-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy.processPendingOperations(QueuingRrdStrategy.java:1150) [opennms-rrd-api-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy.run(QueuingRrdStrategy.java:1105) [opennms-rrd-api-15.0.0.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75] Caused by: org.jrobin.core.RrdException: Bad sample timestamp 1422565840. Last update time was 1422565840, at least one second step is required at org.jrobin.core.RrdDb.store(RrdDb.java:593) ~[jrobin-1.6.0.jar:1.6.0] at org.jrobin.core.Sample.update(Sample.java:221) ~[jrobin-1.6.0.jar:1.6.0] at org.jrobin.core.Sample.setAndUpdate(Sample.java:243) ~[jrobin-1.6.0.jar:1.6.0] at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:237) ~[opennms-rrd-jrobin-15.0.0.jar:?] at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:72) ~[opennms-rrd-jrobin-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:570) ~[opennms-rrd-api-15.0.0.jar:?] ... 3 more 2015-01-29 16:10:39,711 DEBUG [QueuingRrdStrategy-2] O.Queued: Error updating file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: 1422565840:0 [0.001 sec] 2015-01-29 16:10:39,711 DEBUG [QueuingRrdStrategy-2] O.Queued: Error updating file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: 1422565840:0 java.lang.Exception: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: 1422565840:0 at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:572) ~[opennms-rrd-api-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy.processPendingOperations(QueuingRrdStrategy.java:1150) [opennms-rrd-api-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy.run(QueuingRrdStrategy.java:1105) [opennms-rrd-api-15.0.0.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75] Caused by: org.jrobin.core.RrdException: Bad sample timestamp 1422565840. Last update time was 1422565840, at least one second step is required at org.jrobin.core.RrdDb.store(RrdDb.java:593) ~[jrobin-1.6.0.jar:1.6.0] at org.jrobin.core.Sample.update(Sample.java:221) ~[jrobin-1.6.0.jar:1.6.0] at org.jrobin.core.Sample.setAndUpdate(Sample.java:243) ~[jrobin-1.6.0.jar:1.6.0] at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:237) ~[opennms-rrd-jrobin-15.0.0.jar:?] at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:72) ~[opennms-rrd-jrobin-15.0.0.jar:?] at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:570) ~[opennms-rrd-api-15.0.0.jar:?] ... 3 more 2015-01-29 16:10:41,854 DEBUG [java.util.concurrent.ThreadPoolExecutor@131766f6[Running, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]] o.o.n.s.LegacyScheduler: run: found ready runnable ScheduleEntry[expCode=1] for PollableService [PollableInterface [PollableNode [97]:172.20.1.41]:Update] (ready in 0ms)
In diagnosing another problem, I found these logs in the poller.log file:
java.lang.Exception: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutDiscards.jrb: 1422565840:0
at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:572) ~[opennms-rrd-api-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy.processPendingOperations(QueuingRrdStrategy.java:1150) [opennms-rrd-api-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy.run(QueuingRrdStrategy.java:1105) [opennms-rrd-api-15.0.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]
Caused by: org.jrobin.core.RrdException: Bad sample timestamp 1422565840. Last update time was 1422565840, at least one second step is required
at org.jrobin.core.RrdDb.store(RrdDb.java:593) ~[jrobin-1.6.0.jar:1.6.0]
at org.jrobin.core.Sample.update(Sample.java:221) ~[jrobin-1.6.0.jar:1.6.0]
at org.jrobin.core.Sample.setAndUpdate(Sample.java:243) ~[jrobin-1.6.0.jar:1.6.0]
at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:237) ~[opennms-rrd-jrobin-15.0.0.jar:?]
at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:72) ~[opennms-rrd-jrobin-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:570) ~[opennms-rrd-api-15.0.0.jar:?]
... 3 more
2015-01-29 16:10:39,710 DEBUG [QueuingRrdStrategy-1] O.Queued: Error updating file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutOctets.jrb: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutOctets.jrb: 1422565840:0
java.lang.Exception: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifOutOctets.jrb: 1422565840:0
at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:572) ~[opennms-rrd-api-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy.processPendingOperations(QueuingRrdStrategy.java:1150) [opennms-rrd-api-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy.run(QueuingRrdStrategy.java:1105) [opennms-rrd-api-15.0.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]
Caused by: org.jrobin.core.RrdException: Bad sample timestamp 1422565840. Last update time was 1422565840, at least one second step is required
at org.jrobin.core.RrdDb.store(RrdDb.java:593) ~[jrobin-1.6.0.jar:1.6.0]
at org.jrobin.core.Sample.update(Sample.java:221) ~[jrobin-1.6.0.jar:1.6.0]
at org.jrobin.core.Sample.setAndUpdate(Sample.java:243) ~[jrobin-1.6.0.jar:1.6.0]
at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:237) ~[opennms-rrd-jrobin-15.0.0.jar:?]
at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:72) ~[opennms-rrd-jrobin-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:570) ~[opennms-rrd-api-15.0.0.jar:?]
... 3 more
2015-01-29 16:10:39,711 DEBUG [QueuingRrdStrategy-2] O.Queued: Error updating file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: 1422565840:0 [0.001 sec]
2015-01-29 16:10:39,711 DEBUG [QueuingRrdStrategy-2] O.Queued: Error updating file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: 1422565840:0
java.lang.Exception: Error processing update 0 for file /opt/opennms/share/rrd/snmp/7/1-100d7fbdf3a6/ifInDiscards.jrb: 1422565840:0
at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:572) ~[opennms-rrd-api-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy.processPendingOperations(QueuingRrdStrategy.java:1150) [opennms-rrd-api-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy.run(QueuingRrdStrategy.java:1105) [opennms-rrd-api-15.0.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]
Caused by: org.jrobin.core.RrdException: Bad sample timestamp 1422565840. Last update time was 1422565840, at least one second step is required
at org.jrobin.core.RrdDb.store(RrdDb.java:593) ~[jrobin-1.6.0.jar:1.6.0]
at org.jrobin.core.Sample.update(Sample.java:221) ~[jrobin-1.6.0.jar:1.6.0]
at org.jrobin.core.Sample.setAndUpdate(Sample.java:243) ~[jrobin-1.6.0.jar:1.6.0]
at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:237) ~[opennms-rrd-jrobin-15.0.0.jar:?]
at org.opennms.netmgt.rrd.jrobin.JRobinRrdStrategy.updateFile(JRobinRrdStrategy.java:72) ~[opennms-rrd-jrobin-15.0.0.jar:?]
at org.opennms.netmgt.rrd.QueuingRrdStrategy$ZeroUpdateOperation.process(QueuingRrdStrategy.java:570) ~[opennms-rrd-api-15.0.0.jar:?]
... 3 more
2015-01-29 16:10:41,854 DEBUG [java.util.concurrent.ThreadPoolExecutor@131766f6[Running, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]] o.o.n.s.LegacyScheduler: run: found ready runnable ScheduleEntry[expCode=1] for PollableService [PollableInterface [PollableNode [97]:172.20.1.41]:Update] (ready in 0ms)