Embedded Jetty blocking HTTP requests due to "Max threads" settings

Description

Embedded Jetty blocking HTTP requests due to "Max threads" settings.

Logs: (webapps)
=======================
2014-04-22 11:25:58,136 DEBUG [qtp9560790-560 Selector124] nio: Starting Thread[qtp9560790-560 Selector124,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@1d024c
2014-04-22 11:25:58,137 DEBUG [qtp9560790-561 Selector125] nio: Starting Thread[qtp9560790-561 Selector125,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@1449e03
2014-04-22 11:25:58,137 DEBUG [Main] AbstractLifeCycle: STARTED org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager@fba78b
2014-04-22 11:25:58,137 DEBUG [qtp9560790-562 Selector126] nio: Starting Thread[qtp9560790-562 Selector126,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@1e206cb
2014-04-22 11:25:58,140 DEBUG [qtp9560790-563 Selector127] nio: Starting Thread[qtp9560790-563 Selector127,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@34e0db
2014-04-22 11:25:58,181 WARN [Main] AbstractConnector: insufficient threads configured for SelectChannelConnector@0.0.0.0:8980
2014-04-22 11:25:58,203 INFO [Main] AbstractConnector: Started SelectChannelConnector@0.0.0.0:8980
2014-04-22 11:25:58,203 DEBUG [Main] AbstractLifeCycle: STARTED SelectChannelConnector@0.0.0.0:8980
2014-04-22 11:25:58,203 DEBUG [Main] AbstractLifeCycle: STARTED org.eclipse.jetty.server.Server@192c0

Due to this i get a blank page while accessing admin portal.

A wget output log is following:-
$ wget -vv http://server:8980/opennms/
--2014-04-22 10:57:54-- http://server1:8980/opennms/
Connecting to server:8980... connected.
HTTP request sent, awaiting response...

I am using a solaris 10 (sparc) box having more CPU's

Logs:
============
$ psrinfo|wc -l
512

$ psrinfo -pv
The physical processor has 128 virtual processors (0-127)
SPARC-T5 (chipid 0, clock 3600 MHz)
The physical processor has 128 virtual processors (128-255)
SPARC-T5 (chipid 1, clock 3600 MHz)
The physical processor has 128 virtual processors (256-383)
SPARC-T5 (chipid 2, clock 3600 MHz)
The physical processor has 128 virtual processors (384-511)
SPARC-T5 (chipid 3, clock 3600 MHz)

:~$ psrinfo -p
4
=================

I suspect this is due to maxthread limits not matching number of CPU cores in my system.
How do set this maxthreads value in integrated jetty server in OpenNMS? Please advise.

Environment

OS = Solaris 10 (sparc) 64 Postgres = 8.3

Acceptance / Success Criteria

None

Lucidchart Diagrams

Activity

Show:

Vibin Manavalan April 27, 2014 at 11:49 PM

When will be 1.12.7 released ?

Benjamin Reed April 24, 2014 at 12:37 PM

In 1.12.7, Jetty has been changed to use a jetty.xml file which can be configured to handle issues like this.

Vibin Manavalan April 24, 2014 at 12:19 PM

This looks like some weird behavior in Jetty whereby if you attempt to set the
max-threads to something lower then the number of CPU's on your system, it will
simply stop with the warning:

insufficient threads configured for SelectChannelConnector@0.0.0.0:8980

At this point it will simply not serve any HTTP request at all, Because of this the WebUI will not work.

Vibin Manavalan April 22, 2014 at 9:00 AM

Embedded Jetty blocking HTTP requests due to "Max threads" settings.

Logs: (webapps)
=======================
2014-04-22 11:25:58,136 DEBUG [qtp9560790-560 Selector124] nio: Starting Thread[qtp9560790-560 Selector124,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@1d024c
2014-04-22 11:25:58,137 DEBUG [qtp9560790-561 Selector125] nio: Starting Thread[qtp9560790-561 Selector125,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@1449e03
2014-04-22 11:25:58,137 DEBUG [Main] AbstractLifeCycle: STARTED org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager@fba78b
2014-04-22 11:25:58,137 DEBUG [qtp9560790-562 Selector126] nio: Starting Thread[qtp9560790-562 Selector126,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@1e206cb
2014-04-22 11:25:58,140 DEBUG [qtp9560790-563 Selector127] nio: Starting Thread[qtp9560790-563 Selector127,5,main] on org.eclipse.jetty.io.nio.SelectorManager$1@34e0db
2014-04-22 11:25:58,181 WARN [Main] AbstractConnector: insufficient threads configured for SelectChannelConnector@0.0.0.0:8980
2014-04-22 11:25:58,203 INFO [Main] AbstractConnector: Started SelectChannelConnector@0.0.0.0:8980
2014-04-22 11:25:58,203 DEBUG [Main] AbstractLifeCycle: STARTED SelectChannelConnector@0.0.0.0:8980
2014-04-22 11:25:58,203 DEBUG [Main] AbstractLifeCycle: STARTED org.eclipse.jetty.server.Server@192c0

Due to this i get a blank page while accessing admin portal.

A wget output log is following:-
$ wget -vv http://163.241.66.138:8980/opennms/
--2014-04-22 10:57:54-- http://server1:8980/opennms/
Connecting to server:8980... connected.
HTTP request sent, awaiting response...

How do set this maxthreads value in integrated jetty server in OpenNMS?

Fixed

Details

Assignee

Reporter

Fix versions

Affects versions

Due date

Priority

PagerDuty

Created April 22, 2014 at 8:37 AM
Updated January 27, 2017 at 4:21 PM
Resolved April 24, 2014 at 12:37 PM

Flag notifications