My jira server keeps shutting down

[omorobot]

I recently upgraded jira from 7.5 to 8.5.7 in an hope that newer version might solve issue like occasional shutting down issue which happens about once a day.

However this upgrade only made things worse as it happens more than 5 times a day!!

Bellow is on of the logs I found in the /opt/atlassian/jira/logs folder.

OpenJDK 64-Bit Server VM (25.202-b08) for linux-amd64 JRE (1.8.0_202-b08), built on Jan 22 2019 13:35:07 by "jenkins" with gcc 4.8.2 20140120 (Red Hat 4.8.2-15)
Memory: 4k page, physical 16295700k(6870460k free), swap 2097148k(2097148k free)
CommandLine flags: -XX:+ExplicitGCInvokesConcurrent -XX:GCLogFileSize=20971520 -XX:InitialCodeCacheSize=33554432 -XX:InitialHeapSize=402653184 -XX:MaxHeapSize=2147483648 -XX:NumberOfGCLogFiles=5 -XX:-OmitStackTraceInFastThrow -XX:+PrintGC -XX:+PrintGCCause -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ReservedCodeCacheSize=536870912 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseGCLogFileRotation -XX:+UseParallelGC
2020-08-18T16:20:42.016+0900: 1.143: [GC (Allocation Failure) [PSYoungGen: 98304K->15413K(114688K)] 98304K->15493K(376832K), 0.0168952 secs] [Times: user=0.05 sys=0.00, real=0.02 secs]
2020-08-18T16:20:42.334+0900: 1.462: [GC (Allocation Failure) [PSYoungGen: 113717K->12775K(212992K)] 113797K->12863K(475136K), 0.0126318 secs] [Times: user=0.04 sys=0.00, real=0.01 secs]
2020-08-18T16:20:42.793+0900: 1.921: [GC (Allocation Failure) [PSYoungGen: 209383K->16341K(212992K)] 209471K->16429K(475136K), 0.0292033 secs] [Times: user=0.10 sys=0.01, real=0.03 secs]
2020-08-18T16:20:43.188+0900: 2.316: [GC (Allocation Failure) [PSYoungGen: 212949K->16357K(409600K)] 213037K->18681K(671744K), 0.0197154 secs] [Times: user=0.05 sys=0.01, real=0.02 secs]
2020-08-18T16:20:44.345+0900: 3.473: [GC (Allocation Failure) [PSYoungGen: 409573K->16360K(409600K)] 411897K->30677K(671744K), 0.0284137 secs] [Times: user=0.07 sys=0.00, real=0.03 secs]
2020-08-18T16:20:44.505+0900: 3.633: [GC (Metadata GC Threshold) [PSYoungGen: 63889K->17745K(672256K)] 78206K->32071K(934400K), 0.0189638 secs] [Times: user=0.06 sys=0.01, real=0.02 secs]
2020-08-18T16:20:44.524+0900: 3.652: [Full GC (Metadata GC Threshold) [PSYoungGen: 17745K->0K(672256K)] [ParOldGen: 14325K->17911K(262144K)] 32071K->17911K(934400K), [Metaspace: 20638K->20638K(1069056K)], 0.0533530 secs] [Times: user=0.17 sys=0.00, real=0.05 secs]
2020-08-18T16:20:50.743+0900: 9.871: [GC (System.gc()) [PSYoungGen: 313177K->12274K(670720K)] 331088K->30201K(932864K), 0.0136218 secs] [Times: user=0.04 sys=0.01, real=0.01 secs]
2020-08-18T16:20:50.757+0900: 9.885: [Full GC (System.gc()) [PSYoungGen: 12274K->0K(670720K)] [ParOldGen: 17927K->28136K(262144K)] 30201K->28136K(932864K), [Metaspace: 31111K->31111K(1077248K)], 0.0955064 secs] [Times: user=0.27 sys=0.01, real=0.10 secs]
2020-08-18T16:20:53.568+0900: 12.696: [GC (Metadata GC Threshold) [PSYoungGen: 577178K->16726K(671232K)] 605314K->44870K(933376K), 0.0160404 secs] [Times: user=0.04 sys=0.00, real=0.02 secs]
2020-08-18T16:20:53.584+0900: 12.712: [Full GC (Metadata GC Threshold) [PSYoungGen: 16726K->0K(671232K)] [ParOldGen: 28144K->39262K(262144K)] 44870K->39262K(933376K), [Metaspace: 52392K->52392K(1095680K)], 0.1406862 secs] [Times: user=0.39 sys=0.00, real=0.14 secs]
2020-08-18T16:20:56.013+0900: 15.141: [GC (Allocation Failure) [PSYoungGen: 645120K->23759K(670720K)] 684382K->63030K(932864K), 0.0317261 secs] [Times: user=0.10 sys=0.00, real=0.03 secs]
2020-08-18T16:20:59.087+0900: 18.215: [GC (Allocation Failure) [PSYoungGen: 668879K->27637K(654848K)] 708150K->82876K(916992K), 0.0497292 secs] [Times: user=0.17 sys=0.01, real=0.05 secs]
2020-08-18T16:21:00.391+0900: 19.519: [GC (Allocation Failure) [PSYoungGen: 654837K->26580K(653824K)] 710076K->108890K(915968K), 0.0585198 secs] [Times: user=0.19 sys=0.00, real=0.06 secs]
2020-08-18T16:21:02.173+0900: 21.301: [GC (Allocation Failure) [PSYoungGen: 653780K->36837K(644608K)] 736090K->130907K(906752K), 0.0436541 secs] [Times: user=0.15 sys=0.01, real=0.04 secs]
2020-08-18T16:21:04.509+0900: 23.637: [GC (Allocation Failure) [PSYoungGen: 644581K->45551K(653312K)] 738651K->168736K(915456K), 0.0626668 secs] [Times: user=0.20 sys=0.02, real=0.06 secs]
2020-08-18T16:21:04.860+0900: 23.987: [GC (Metadata GC Threshold) [PSYoungGen: 117277K->4842K(618496K)] 240461K->163279K(880640K), 0.0496389 secs] [Times: user=0.13 sys=0.01, real=0.05 secs]
2020-08-18T16:21:04.910+0900: 24.038: [Full GC (Metadata GC Threshold) [PSYoungGen: 4842K->0K(618496K)] [ParOldGen: 158436K->134796K(373248K)] 163279K->134796K(991744K), [Metaspace: 84554K->84538K(1126400K)], 0.2957358 secs] [Times: user=0.91 sys=0.00, real=0.30 secs]
2020-08-18T16:21:09.398+0900: 28.526: [GC (Allocation Failure) [PSYoungGen: 572928K->42128K(615424K)] 707724K->176933K(988672K), 0.0401726 secs] [Times: user=0.13 sys=0.00, real=0.04 secs]
2020-08-18T16:21:11.147+0900: 30.275: [GC (Allocation Failure) [PSYoungGen: 615056K->31525K(636416K)] 749861K->186847K(1009664K), 0.0414614 secs] [Times: user=0.15 sys=0.00, real=0.04 secs]
2020-08-18T16:21:12.493+0900: 31.621: [GC (Allocation Failure) [PSYoungGen: 602917K->30392K(602112K)] 758239K->200924K(975360K), 0.0470438 secs] [Times: user=0.16 sys=0.00, real=0.04 secs]
2020-08-18T16:21:13.806+0900: 32.934: [GC (Allocation Failure) [PSYoungGen: 601784K->32626K(632832K)] 772316K->220711K(1006080K), 0.0447794 secs] [Times: user=0.15 sys=0.01, real=0.04 secs]
2020-08-18T16:21:15.473+0900: 34.601: [GC (Allocation Failure) [PSYoungGen: 605554K->34964K(631296K)] 793639K->239116K(1004544K), 0.0395529 secs] [Times: user=0.13 sys=0.01, real=0.04 secs]
2020-08-18T16:21:16.215+0900: 35.343: [GC (Metadata GC Threshold) [PSYoungGen: 278339K->15000K(637952K)] 482490K->240837K(1011200K), 0.0324563 secs] [Times: user=0.11 sys=0.00, real=0.03 secs]
2020-08-18T16:21:16.248+0900: 35.375: [Full GC (Metadata GC Threshold) [PSYoungGen: 15000K->0K(637952K)] [ParOldGen: 225836K->229862K(526848K)] 240837K->229862K(1164800K), [Metaspace: 134354K->134354K(1177600K)], 0.5621264 secs] [Times: user=1.78 sys=0.01, real=0.56 secs]
2020-08-18T16:21:18.434+0900: 37.562: [GC (Allocation Failure) [PSYoungGen: 580608K->29042K(637952K)] 810470K->258912K(1164800K), 0.0276520 secs] [Times: user=0.08 sys=0.00, real=0.03 secs]
2020-08-18T16:21:19.392+0900: 38.519: [GC (Allocation Failure) [PSYoungGen: 609650K->41394K(636928K)] 839520K->271273K(1163776K), 0.0372857 secs] [Times: user=0.13 sys=0.00, real=0.04 secs]
2020-08-18T16:21:20.971+0900: 40.099: [GC (Allocation Failure) [PSYoungGen: 623538K->37057K(638976K)] 853417K->285377K(1165824K), 0.0574621 secs] [Times: user=0.21 sys=0.00, real=0.06 secs]
2020-08-18T16:21:22.846+0900: 41.974: [GC (Allocation Failure) [PSYoungGen: 619201K->40058K(640000K)] 867521K->301141K(1166848K), 0.0463085 secs] [Times: user=0.15 sys=0.01, real=0.05 secs]
2020-08-18T16:21:24.555+0900: 43.683: [GC (Allocation Failure) [PSYoungGen: 623226K->52795K(636416K)] 884309K->313885K(1163264K), 0.0487102 secs] [Times: user=0.18 sys=0.00, real=0.05 secs]
2020-08-18T16:21:27.086+0900: 46.214: [GC (Allocation Failure) [PSYoungGen: 635963K->62432K(619008K)] 897053K->324104K(1145856K), 0.0607685 secs] [Times: user=0.22 sys=0.00, real=0.06 secs]
2020-08-18T16:21:29.681+0900: 48.809: [GC (Allocation Failure) [PSYoungGen: 618976K->30590K(627712K)] 880648K->325404K(1154560K), 0.0635288 secs] [Times: user=0.22 sys=0.02, real=0.06 secs]
2020-08-18T16:21:31.497+0900: 50.625: [GC (Allocation Failure) [PSYoungGen: 587134K->38889K(621056K)] 881948K->333711K(1147904K), 0.0313065 secs] [Times: user=0.10 sys=0.00, real=0.03 secs]
2020-08-18T16:21:33.147+0900: 52.275: [GC (Allocation Failure) [PSYoungGen: 597993K->42621K(625664K)] 892815K->337451K(1152512K), 0.0292818 secs] [Times: user=0.10 sys=0.00, real=0.03 secs]
2020-08-18T16:21:35.562+0900: 54.690: [GC (Allocation Failure) [PSYoungGen: 601725K->45368K(631808K)] 896555K->340206K(1158656K), 0.0350881 secs] [Times: user=0.11 sys=0.00, real=0.03 secs]
2020-08-18T16:21:38.273+0900: 57.401: [GC (Allocation Failure) [PSYoungGen: 611128K->66550K(632320K)] 905966K->369206K(1159168K), 0.0525668 secs] [Times: user=0.14 sys=0.00, real=0.05 secs]
2020-08-18T16:21:40.020+0900: 59.148: [GC (Allocation Failure) [PSYoungGen: 632310K->46288K(614912K)] 934966K->370834K(1141760K), 0.0604870 secs] [Times: user=0.14 sys=0.02, real=0.06 secs]
2020-08-18T16:21:55.602+0900: 74.729: [GC (Allocation Failure) [PSYoungGen: 594640K->51268K(600064K)] 919186K->375822K(1126912K), 0.0502707 secs] [Times: user=0.14 sys=0.00, real=0.04 secs]
2020-08-18T16:21:58.491+0900: 77.618: [GC (Allocation Failure) [PSYoungGen: 599620K->75766K(596480K)] 924174K->413425K(1123328K), 0.0780355 secs] [Times: user=0.22 sys=0.01, real=0.08 secs]
2020-08-18T16:22:00.550+0900: 79.678: [GC (Allocation Failure) [PSYoungGen: 596470K->89067K(609792K)] 934129K->444963K(1136640K), 0.0823891 secs] [Times: user=0.24 sys=0.01, real=0.09 secs]
2020-08-18T16:22:01.675+0900: 80.803: [GC (Allocation Failure) [PSYoungGen: 609771K->89061K(530944K)] 965667K->480406K(1057792K), 0.1117477 secs] [Times: user=0.35 sys=0.03, real=0.11 secs]
2020-08-18T16:22:03.871+0900: 82.999: [GC (Allocation Failure) [PSYoungGen: 530917K->102133K(544256K)] 922262K->506061K(1071104K), 0.1006203 secs] [Times: user=0.26 sys=0.02, real=0.10 secs]
2020-08-18T16:22:06.475+0900: 85.603: [GC (Allocation Failure) [PSYoungGen: 543989K->92933K(555008K)] 947917K->520686K(1081856K), 0.1200383 secs] [Times: user=0.30 sys=0.00, real=0.12 secs]
2020-08-18T16:22:08.822+0900: 87.950: [GC (Allocation Failure) [PSYoungGen: 511237K->73854K(492544K)] 938990K->539659K(1019392K), 0.1424534 secs] [Times: user=0.35 sys=0.01, real=0.14 secs]
2020-08-18T16:22:43.153+0900: 122.281: [GC (Allocation Failure) [PSYoungGen: 492158K->39465K(558592K)] 957963K->548104K(1085440K), 0.1593316 secs] [Times: user=0.26 sys=0.02, real=0.15 secs]
2020-08-18T16:22:43.312+0900: 122.440: [Full GC (Ergonomics) [PSYoungGen: 39465K->0K(558592K)] [ParOldGen: 508639K->478792K(839680K)] 548104K->478792K(1398272K), [Metaspace: 220943K->220884K(1257472K)], 1.3491308 secs] [Times: user=3.64 sys=0.01, real=1.36 secs]
2020-08-18T16:23:41.497+0900: 180.625: [GC (Allocation Failure) [PSYoungGen: 423424K->10503K(557056K)] 902216K->489304K(1396736K), 0.0687327 secs] [Times: user=0.10 sys=0.00, real=0.07 secs]
2020-08-18T16:27:16.004+0900: 395.132: [GC (Allocation Failure) [PSYoungGen: 433927K->26437K(563200K)] 912728K->505246K(1402880K), 0.0891526 secs] [Times: user=0.17 sys=0.00, real=0.09 secs]
2020-08-18T16:27:17.790+0900: 396.918: [GC (Allocation Failure) [PSYoungGen: 454981K->38186K(466944K)] 933790K->517003K(1306624K), 0.0823280 secs] [Times: user=0.14 sys=0.00, real=0.09 secs]
2020-08-18T16:27:18.560+0900: 397.688: [GC (Allocation Failure) [PSYoungGen: 466730K->39289K(564736K)] 945547K->526944K(1404416K), 0.1100074 secs] [Times: user=0.29 sys=0.00, real=0.11 secs]
2020-08-18T16:27:22.466+0900: 401.594: [GC (Allocation Failure) [PSYoungGen: 474489K->31283K(559616K)] 962144K->540842K(1399296K), 0.1111877 secs] [Times: user=0.21 sys=0.00, real=0.11 secs]
2020-08-18T16:33:17.944+0900: 757.072: [GC (Allocation Failure) [PSYoungGen: 466483K->26961K(569344K)] 976042K->547843K(1409024K), 0.1338846 secs] [Times: user=0.15 sys=0.00, real=0.13 secs]

Seems like it is relate to Garbage collection which I don't know how to solve.

I am currently running jira on a ubuntu machine with 16 Gigs of ram. 

Please help me solve this issue. 

[Nic Brough -Adaptavist- · Accepted solution]

Allocation failure generally suggests you have not got enough memory for it to work.

Your maximum heap size is set to 2Gb, so I assume you have a moderately large Jira (lots of issues and users and some hefty apps installed like Service Desk, not a new Jira with little data), and you're trying to upgrade or migrate it to another server.

I would try gradually increasing that - try 2.5Gb first, then 3Gb, and so on.  If you get to 8Gb, then I am looking in the wrong area.

[omorobot]

Thank you for such a quick answer.

I actually found a thread very similar to my symptoms here https://community.atlassian.com/t5/Jira-Software-questions/Jira-is-terminating-Ubuntu-18-04/qaq-p/1319708

and I checked my setenv.sh file and found 

JVM_MINIMUM_MEMORY="384m"
JVM_MAXIMUM_MEMORY="2048m"

which seems very low. 

So I changed this value to 1024m and 4096m respectively and restarted my jira.

Will see if this solves the issue.

[Nic Brough -Adaptavist-]

The jvm max you've found there comes out in the -XX:MaxHeapSize you have at the top of your log.

[omorobot]

Actually our server only has 6~7 active users and there are currently no more than 50 issues running.

I don't understand this is such a burden to my jira server. 

Anyway, after changing the heap size, the server does not shut down so far.

[Nic Brough -Adaptavist-]

Nor do I!  An off-the-shelf Jira will work fine at that scale, and that's set up with less than 1Gb heap size!

This suggests there is something else wrong.  Do you have a lot of apps and applications added to it?  Do you have automations or external calls hitting it?

Is it possible to monitor the server while it is running to see if there are patterns of heavy using or even just creeping memory increases?

[omorobot]

Our jira server downed last night. 

It looks like the problem is still on. 

In fact I am running confluence and jira in the same desktop server on different port. 

Is this setup can make things worse at running jira? 

Also there are less then 10 active user.

Below is the latest log I gathered from the server.

OpenJDK 64-Bit Server VM (25.202-b08) for linux-amd64 JRE (1.8.0_202-b08), built on Jan 22 2019 13:35:07 by "jenkins" with gcc 4.8.2 20140120 (Red Hat 4.8.2-15)
Memory: 4k page, physical 32786188k(22858008k free), swap 2097148k(2097148k free)
CommandLine flags: -XX:+ExplicitGCInvokesConcurrent -XX:GCLogFileSize=20971520 -XX:InitialCodeCacheSize=33554432 -XX:InitialHeapSize=1073741824 -XX:MaxHeapSize=4294967296 -XX:NumberOfGCLogFiles=5 -XX:-OmitStackTraceInFastThrow -XX:+PrintGC -XX:+PrintGCCause -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ReservedCodeCacheSize=536870912 -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseGCLogFileRotation -XX:+UseParallelGC
2020-08-21T08:48:50.486+0900: 1.543: [GC (Allocation Failure) [PSYoungGen: 262144K->18868K(305664K)] 262144K->19021K(1005056K), 0.0242760 secs] [Times: user=0.07 sys=0.01, real=0.02 secs]
2020-08-21T08:48:51.028+0900: 2.086: [GC (Allocation Failure) [PSYoungGen: 281012K->18326K(567808K)] 281165K->18486K(1267200K), 0.0264057 secs] [Times: user=0.10 sys=0.01, real=0.03 secs]
2020-08-21T08:48:52.540+0900: 3.598: [GC (Allocation Failure) [PSYoungGen: 542614K->31234K(567808K)] 542774K->31418K(1267200K), 0.0434834 secs] [Times: user=0.13 sys=0.02, real=0.04 secs]
2020-08-21T08:48:52.601+0900: 3.659: [GC (Metadata GC Threshold) [PSYoungGen: 43035K->16960K(1092096K)] 43219K->17152K(1791488K), 0.0210982 secs] [Times: user=0.07 sys=0.00, real=0.02 secs]
2020-08-21T08:48:52.623+0900: 3.680: [Full GC (Metadata GC Threshold) [PSYoungGen: 16960K->0K(1092096K)] [ParOldGen: 192K->16934K(699392K)] 17152K->16934K(1791488K), [Metaspace: 20701K->20701K(1069056K)], 0.0814597 secs] [Times: user=0.27 sys=0.02, real=0.08 secs]
2020-08-21T08:48:56.374+0900: 7.431: [GC (Metadata GC Threshold) [PSYoungGen: 375457K->16993K(1092096K)] 392391K->33935K(1791488K), 0.0227047 secs] [Times: user=0.03 sys=0.01, real=0.02 secs]
2020-08-21T08:48:56.396+0900: 7.454: [Full GC (Metadata GC Threshold) [PSYoungGen: 16993K->0K(1092096K)] [ParOldGen: 16942K->32638K(699392K)] 33935K->32638K(1791488K), [Metaspace: 34582K->34582K(1081344K)], 0.1081103 secs] [Times: user=0.32 sys=0.01, real=0.10 secs]
2020-08-21T08:48:58.999+0900: 10.056: [GC (System.gc()) [PSYoungGen: 123147K->1002K(1338368K)] 155786K->33649K(2037760K), 0.0101688 secs] [Times: user=0.02 sys=0.00, real=0.01 secs]
2020-08-21T08:48:59.009+0900: 10.067: [Full GC (System.gc()) [PSYoungGen: 1002K->0K(1338368K)] [ParOldGen: 32646K->25315K(699392K)] 33649K->25315K(2037760K), [Metaspace: 35279K->35279K(1081344K)], 0.0950578 secs] [Times: user=0.27 sys=0.00, real=0.09 secs]
2020-08-21T08:49:01.830+0900: 12.888: [GC (Metadata GC Threshold) [PSYoungGen: 701836K->21243K(1341440K)] 727152K->46567K(2040832K), 0.0205280 secs] [Times: user=0.04 sys=0.01, real=0.02 secs]
2020-08-21T08:49:01.851+0900: 12.908: [Full GC (Metadata GC Threshold) [PSYoungGen: 21243K->0K(1341440K)] [ParOldGen: 25323K->45183K(699392K)] 46567K->45183K(2040832K), [Metaspace: 59145K->59145K(1101824K)], 0.0847367 secs] [Times: user=0.20 sys=0.00, real=0.09 secs]
2020-08-21T08:49:07.155+0900: 18.212: [GC (Allocation Failure) [PSYoungGen: 1307648K->33256K(1335808K)] 1352831K->99266K(2035200K), 0.0746026 secs] [Times: user=0.25 sys=0.02, real=0.07 secs]
2020-08-21T08:49:10.413+0900: 21.470: [GC (Allocation Failure) [PSYoungGen: 1335784K->47593K(1350144K)] 1401794K->163727K(2049536K), 0.0839176 secs] [Times: user=0.27 sys=0.04, real=0.09 secs]
2020-08-21T08:49:16.409+0900: 27.467: [GC (GCLocker Initiated GC) [PSYoungGen: 1114913K->47603K(1235456K)] 1231048K->239930K(1934848K), 0.0847518 secs] [Times: user=0.26 sys=0.05, real=0.09 secs]
2020-08-21T08:49:16.517+0900: 27.574: [GC (Metadata GC Threshold) [PSYoungGen: 71226K->544K(1188864K)] 263552K->240707K(1888256K), 0.0456053 secs] [Times: user=0.15 sys=0.03, real=0.04 secs]
2020-08-21T08:49:16.563+0900: 27.620: [Full GC (Metadata GC Threshold) [PSYoungGen: 544K->0K(1188864K)] [ParOldGen: 240163K->196561K(699392K)] 240707K->196561K(1888256K), [Metaspace: 94056K->94010K(1136640K)], 0.3218587 secs] [Times: user=0.90 sys=0.01, real=0.32 secs]
2020-08-21T08:49:21.219+0900: 32.276: [GC (Allocation Failure) [PSYoungGen: 1187840K->68199K(1282048K)] 1384401K->264769K(1981440K), 0.0523625 secs] [Times: user=0.17 sys=0.00, real=0.05 secs]
2020-08-21T08:49:24.149+0900: 35.206: [GC (Allocation Failure) [PSYoungGen: 1244775K->60376K(1236992K)] 1441345K->292573K(1936384K), 0.0709272 secs] [Times: user=0.22 sys=0.00, real=0.07 secs]
2020-08-21T08:49:27.425+0900: 38.483: [GC (Allocation Failure) [PSYoungGen: 1236952K->58590K(1287168K)] 1469149K->322280K(1986560K), 0.0715118 secs] [Times: user=0.25 sys=0.01, real=0.07 secs]
2020-08-21T08:49:28.245+0900: 39.302: [GC (Metadata GC Threshold) [PSYoungGen: 467890K->16770K(1192960K)] 731580K->319573K(1892352K), 0.0607119 secs] [Times: user=0.20 sys=0.03, real=0.07 secs]
2020-08-21T08:49:28.306+0900: 39.363: [Full GC (Metadata GC Threshold) [PSYoungGen: 16770K->0K(1192960K)] [ParOldGen: 302802K->261105K(793600K)] 319573K->261105K(1986560K), [Metaspace: 153440K->153440K(1193984K)], 0.5650303 secs] [Times: user=1.91 sys=0.01, real=0.56 secs]
2020-08-21T08:49:32.299+0900: 43.356: [GC (Allocation Failure) [PSYoungGen: 1176064K->45725K(1289728K)] 1437169K->306839K(2083328K), 0.0464776 secs] [Times: user=0.16 sys=0.00, real=0.05 secs]
2020-08-21T08:49:36.565+0900: 47.622: [GC (Allocation Failure) [PSYoungGen: 1226909K->31329K(1284608K)] 1488023K->327510K(2078208K), 0.0575647 secs] [Times: user=0.20 sys=0.00, real=0.06 secs]
2020-08-21T08:49:40.349+0900: 51.406: [GC (Allocation Failure) [PSYoungGen: 1212513K->19334K(1286656K)] 1508694K->338249K(2080256K), 0.0431154 secs] [Times: user=0.15 sys=0.00, real=0.04 secs]
2020-08-21T08:49:44.755+0900: 55.813: [GC (Allocation Failure) [PSYoungGen: 1207174K->15292K(1284608K)] 1526089K->346012K(2078208K), 0.0313474 secs] [Times: user=0.09 sys=0.00, real=0.03 secs]
2020-08-21T08:49:54.641+0900: 65.699: [GC (Allocation Failure) [PSYoungGen: 1203132K->53552K(1296384K)] 1533852K->395677K(2089984K), 0.0572623 secs] [Times: user=0.13 sys=0.00, real=0.06 secs]
2020-08-21T08:50:05.771+0900: 76.829: [GC (Allocation Failure) [PSYoungGen: 1255216K->26594K(1296896K)] 1597341K->392210K(2090496K), 0.0821918 secs] [Times: user=0.17 sys=0.01, real=0.09 secs]
2020-08-21T08:50:09.070+0900: 80.127: [GC (Allocation Failure) [PSYoungGen: 1228258K->91626K(1267200K)] 1593874K->470116K(2060800K), 0.0907132 secs] [Times: user=0.24 sys=0.01, real=0.09 secs]
2020-08-21T08:50:12.316+0900: 83.374: [GC (Allocation Failure) [PSYoungGen: 1267178K->84430K(1260032K)] 1645668K->534547K(2053632K), 0.1547541 secs] [Times: user=0.45 sys=0.04, real=0.15 secs]
2020-08-21T08:50:16.662+0900: 87.719: [GC (Allocation Failure) [PSYoungGen: 1259982K->64999K(1278976K)] 1710099K->567084K(2072576K), 0.1385080 secs] [Times: user=0.31 sys=0.02, real=0.14 secs]

[omorobot]

I keep monitoring memory usage of the system info page in jira and here are what I got.

It starts from about 600 MB and then gradually increase to 1.6 GB of memory in just about 1 minute and back to 600 MB again and constantly doing this behavior.

It seems like there's memory leaks in the service. 

I am running the server with 32 GB of memory.

Any suggestions?

[Nic Brough -Adaptavist-]

It is not a memory leak - the symptoms of those is that the memory usage increases and never drops, eventually reaching the max and falling over.

It is perfectly normal to see memory usage going up and down in a Java application.

The error messages you are posting are in fact only warnings that the JVM is about to clear up some memory - it may pause while doing this, but not for more than a few seconds.

We need to see the error messages that are happening at the time you say it is crashing.

[omorobot]

OK if that is normal thing, how can I see error message right at the time jira is crashing? 

It happens so suddenly that I can't constantly monitor it.

Is there a way to run jira as debug mode and place break points or something?

P.S

During the time of writing this reply, I experienced a crash of both jira and confluence.

[Nic Brough -Adaptavist-]

When it crashes, the process will write something into the log and then stop.

Make a copy of the logs before restarting the application, then you'll be able to read up from the end of the log to where the errors start.

[omorobot]

@Nic Brough -Adaptavist-  I changed the power supply and crashing does not happen again so far as below.

It turned out jira is not the problem. 

Thank you for kindly leaving messages.