Smoke tests failing because OSGi features fail to install: "The framework has been shutdown"
Description
Acceptance / Success Criteria
Lucidchart Diagrams
Activity
Seth Leger August 12, 2015 at 2:50 PM
This was due to the fact that the crummy activemq-karaf POM has a lot of OSGi dependencies marked as "compile" instead of "provided" so the OSGi JARs (from Karaf, Felix, etc) were getting pulled in as concrete dependencies and added into our /lib directory.
I added exclusions for them in our ActiveMQ dependencies and the smoke tests are passing now. Marking as fixed.
commit a7f098adc15f4808c6d98a317d927d6bb468d754
Seth Leger August 11, 2015 at 12:03 PM
Here's the log:
2015-08-11 11:32:19,924 INFO org.apache.felix.fileinstall:3.4.2(6) [FelixStartLevel] org.apache.felix.fileinstall: Creating configuration from jmx.acl.java.lang.Memory.cfg
2015-08-11 11:32:19,925 INFO org.apache.felix.fileinstall:3.4.2(6) [FelixStartLevel] org.apache.felix.fileinstall: Creating configuration from org.opennms.features.topology.plugins.topo.simple-test.cfg
2015-08-11 11:32:22,953 DEBUG org.opennms.container.web.bridge:17.0.0.SNAPSHOT(42) [pool-98-thread-1] org.opennms.container.web.bridge: BundleEvent INSTALLED - org.opennms.container.web.bridge
2015-08-11 11:32:23,266 DEBUG org.opennms.core.castor-properties:17.0.0.SNAPSHOT(66) [pool-98-thread-1] org.opennms.core.castor-properties: BundleEvent INSTALLED - org.opennms.core.castor-properties
2015-08-11 11:32:23,667 DEBUG org.opennms.core.api:17.0.0.SNAPSHOT(75) [pool-98-thread-1] org.opennms.core.api: BundleEvent INSTALLED - org.opennms.core.api
2015-08-11 11:32:23,669 DEBUG org.opennms.core.criteria:17.0.0.SNAPSHOT(76) [pool-98-thread-1] org.opennms.core.criteria: BundleEvent INSTALLED - org.opennms.core.criteria
2015-08-11 11:32:23,671 DEBUG org.opennms.core.lib:17.0.0.SNAPSHOT(77) [pool-98-thread-1] org.opennms.core.lib: BundleEvent INSTALLED - org.opennms.core.lib
2015-08-11 11:32:23,672 DEBUG org.opennms.core.logging:17.0.0.SNAPSHOT(78) [pool-98-thread-1] org.opennms.core.logging: BundleEvent INSTALLED - org.opennms.core.logging
2015-08-11 11:32:23,676 DEBUG org.opennms.core.soa:17.0.0.SNAPSHOT(79) [pool-98-thread-1] org.opennms.core.soa: BundleEvent INSTALLED - org.opennms.core.soa
2015-08-11 11:32:23,684 DEBUG org.opennms.core.spring:17.0.0.SNAPSHOT(80) [pool-98-thread-1] org.opennms.core.spring: BundleEvent INSTALLED - org.opennms.core.spring
2015-08-11 11:32:23,689 DEBUG org.opennms.core.xml:17.0.0.SNAPSHOT(81) [pool-98-thread-1] org.opennms.core.xml: BundleEvent INSTALLED - org.opennms.core.xml
2015-08-11 11:32:23,691 DEBUG org.opennms.opennms-util:17.0.0.SNAPSHOT(82) [pool-98-thread-1] org.opennms.opennms-util: BundleEvent INSTALLED - org.opennms.opennms-util
2015-08-11 11:32:23,721 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature opennms-topology-runtime-browser
s: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:23,820 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature opennms-topology-runtime-linkd:
org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:23,951 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature opennms-topology-runtime-simple:
org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,062 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature opennms-topology-runtime-vmware:
org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,062 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature osgi-nrtg-local: org.osgi.framew
ork.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,174 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature vaadin-node-maps: org.osgi.frame
work.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,274 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature vaadin-snmp-events-and-metrics:
org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,363 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature vaadin-dashboard: org.osgi.frame
work.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,465 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-summary: org.osgi.framew
ork.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,541 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-alarms: org.osgi.framewo
rk.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,620 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-map: org.osgi.framework.
BundleException: The framework has been shutdown.
2015-08-11 11:32:24,839 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-image: org.osgi.framewor
k.BundleException: The framework has been shutdown.
2015-08-11 11:32:24,935 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-charts: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,054 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-rtc: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,131 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-rrd: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,380 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-ksc: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,457 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-topology: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,538 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-url: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,851 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature dashlet-surveillance: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,935 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature vaadin-surveillance-views: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:25,946 WARN org.apache.karaf.features.core:2.4.0(7) [pool-98-thread-1] org.apache.karaf.features.internal.FeaturesServiceImpl: Error when installing feature vaadin-jmxconfiggenerator: org.osgi.framework.BundleException: The framework has been shutdown.
2015-08-11 11:32:26,105 INFO org.apache.aries.blueprint.core:1.4.1(14) [FelixStartLevel] org.apache.aries.blueprint.container.BlueprintExtender: No quiesce support is available, so blueprint components will not participate in quiesce operations
2015-08-11 11:32:26,210 INFO org.ops4j.pax.web.pax-web-runtime:3.1.2(51) [FelixStartLevel] org.ops4j.pax.web.service.internal.Activator: EventAdmin support is not available, no servlet events will be posted!
2015-08-11 11:32:26,211 INFO org.ops4j.pax.web.pax-web-runtime:3.1.2(51) [FelixStartLevel] org.ops4j.pax.web.service.internal.Activator: LogService support enabled, log events will be created.
2015-08-11 11:32:26,211 INFO org.ops4j.pax.web.pax-web-runtime:3.1.2(51) [FelixStartLevel] org.ops4j.pax.web.service.internal.Activator: Pax Web started
...
So some features start to install, then all of a sudden we get a lot of "The framework has been shutdown" messages and those features fail to install. Then it appears that the framework is available again and the rest of the system boots normally. I don't remember seeing anything like this in any previous version of OpenNMS.
Details
Assignee
Seth LegerSeth LegerReporter
Seth LegerSeth LegerComponents
Sprint
NoneFix versions
Affects versions
Priority
Blocker
Details
Details
Assignee
Reporter
Components
Sprint
Fix versions
Affects versions
Priority
PagerDuty
PagerDuty Incident
PagerDuty
PagerDuty Incident
PagerDuty

After some recent merges, we're getting a repeating failure in Bamboo. After trying the code out on my own system, I can reproduce the failure. Many of the OpenNMS Karaf features are failing to install on initial startup. I'll attach a log in the next comment.