Jira 7.7: http-nio-8082-exec-6 ERROR anonymous

[Przemek / Pshemek]

Hello,

our Jira 7.7 throws some errors into catalina.out:

2018-03-29 15:29:14,568 http-nio-8082-exec-6 ERROR anonymous 929x43697x3 1xaly1l 81.148.212.130,10.201.4.4 /s/b41385753107248936698d922d864b2d-CDN/-ltdod3/77001/5f47a8b22de41220aed3e2aee2731726/c502929457dee18bfd1c4716bc86fa7f/_/download/contextbatch/js/jira.general,-_super/batch.js [o.a.c.c.C.[.[localhost].[/].[file-server]] Servlet.service() for servlet file-server threw exception
java.lang.RuntimeException: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
 at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:113)
 at com.atlassian.plugin.cache.filecache.impl.OneStreamCache.stream(OneStreamCache.java:54)
 at com.atlassian.plugin.cache.filecache.impl.FileCacheImpl.cache(FileCacheImpl.java:87)
 at com.atlassian.plugin.webresource.impl.http.Controller.sendCachedInProduction(Controller.java:319)
 at com.atlassian.plugin.webresource.impl.http.Controller.sendCached(Controller.java:282)
 at com.atlassian.plugin.webresource.impl.http.Controller.serveResources(Controller.java:222)
 at com.atlassian.plugin.webresource.impl.http.Controller.serveBatch(Controller.java:84)
 at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:78)
 at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:71)
 at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.callHandler(BaseRouter.java:169)
 at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.dispatch(BaseRouter.java:144)
 at com.atlassian.plugin.webresource.servlet.PluginResourceDownload.serveFile(PluginResourceDownload.java:65)
 at com.atlassian.plugin.servlet.AbstractFileServerServlet.doGet(AbstractFileServerServlet.java:28)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:622)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
 ... 44 filtered
 at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
 ... 39 filtered
 at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:66)
 ... 1 filtered
 at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:64)
 ... 20 filtered
 at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
 ... 12 filtered
 at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
 ... 7 filtered
 at com.atlassian.jira.plugin.webresource.CachingResourceDownloadRewriteRule$1.execute(CachingResourceDownloadRewriteRule.java:60)
 at org.tuckey.web.filters.urlrewrite.RewrittenUrlClass.doRewrite(RewrittenUrlClass.java:61)
 ... 6 filtered
 at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
 ... 10 filtered
 at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
 ... 4 filtered
 at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
 ... 26 filtered
 at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
 ... 23 filtered
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
 at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
 at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
 at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:340)
 at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java:303)
 at org.apache.catalina.connector.CoyoteOutputStream.flush(CoyoteOutputStream.java:109)
 at java.util.zip.DeflaterOutputStream.flush(DeflaterOutputStream.java:282)
 at com.atlassian.gzipfilter.GzipResponseStream.flush(GzipResponseStream.java:31)
 at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:111)
 ... 221 more
Caused by: java.io.IOException: Broken pipe
 at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
 at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
 at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
 at sun.nio.ch.IOUtil.write(IOUtil.java:65)
 at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
 ... 11 filtered
 ... 227 more
2018-03-29 15:29:14,571 http-nio-8082-exec-6 ERROR [o.a.c.c.C.[.[localhost].[/].[noopservlet]] Servlet.service() for servlet [noopservlet] in context with path [] threw exception
java.lang.RuntimeException: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
 at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:113)
 at com.atlassian.plugin.cache.filecache.impl.OneStreamCache.stream(OneStreamCache.java:54)
 at com.atlassian.plugin.cache.filecache.impl.FileCacheImpl.cache(FileCacheImpl.java:87)
 at com.atlassian.plugin.webresource.impl.http.Controller.sendCachedInProduction(Controller.java:319)
 at com.atlassian.plugin.webresource.impl.http.Controller.sendCached(Controller.java:282)
 at com.atlassian.plugin.webresource.impl.http.Controller.serveResources(Controller.java:222)
 at com.atlassian.plugin.webresource.impl.http.Controller.serveBatch(Controller.java:84)
 at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:78)
 at com.atlassian.plugin.webresource.impl.http.Router$5.apply(Router.java:71)
 at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.callHandler(BaseRouter.java:169)
 at com.atlassian.plugin.webresource.impl.support.http.BaseRouter.dispatch(BaseRouter.java:144)
 at com.atlassian.plugin.webresource.servlet.PluginResourceDownload.serveFile(PluginResourceDownload.java:65)
 at com.atlassian.plugin.servlet.AbstractFileServerServlet.doGet(AbstractFileServerServlet.java:28)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:622)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
 ... 44 filtered
 at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
 ... 39 filtered
 at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:66)
 ... 1 filtered
 at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:64)
 ... 20 filtered
 at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
 ... 12 filtered
 at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
 ... 7 filtered
 at com.atlassian.jira.plugin.webresource.CachingResourceDownloadRewriteRule$1.execute(CachingResourceDownloadRewriteRule.java:60)
 at org.tuckey.web.filters.urlrewrite.RewrittenUrlClass.doRewrite(RewrittenUrlClass.java:61)
 ... 6 filtered
 at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
 ... 10 filtered
 at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
 ... 4 filtered
 at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
 ... 26 filtered
 at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
 ... 23 filtered
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
 at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
 at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe
 at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:340)
 at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java:303)
 at org.apache.catalina.connector.CoyoteOutputStream.flush(CoyoteOutputStream.java:109)
 at java.util.zip.DeflaterOutputStream.flush(DeflaterOutputStream.java:282)
 at com.atlassian.gzipfilter.GzipResponseStream.flush(GzipResponseStream.java:31)
 at com.atlassian.plugin.cache.filecache.impl.StreamsCache.streamFromFile(StreamsCache.java:111)
 ... 221 more
Caused by: java.io.IOException: Broken pipe
 at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
 at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
 at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
 at sun.nio.ch.IOUtil.write(IOUtil.java:65)
 at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
 ... 11 filtered
 ... 227 more

What might the reason for that ?

[Ryan Kearney]

Try running the log analyzer to see if any results appear for this. You might also want to try increasing the ulimit on the server and see if that prevents the errors. The errors themselves are generic, so without symptoms it isn't too clear as to what they mean. 

[Przemek / Pshemek]

Log analyzer ? Hmm, haven't heard of it ...

[Przemek / Pshemek]

Found it. Running ...