Cannot start Jira DC instance

[Berk Karabacak]

I cannot start one of Jira DC instance.

All nodes are identical. Increased plugin timeout to 1200 and cleaned the plugin caches as well. Even copied the plugins folder from other working nodes but still i am getting the same error: 

2020-05-18 16:00:17,363+0300 localhost-startStop-1 INFO [c.a.plugin.manager.DefaultPluginManager] Plugin system earlyStartup ended
2020-05-18 16:00:17,381+0300 localhost-startStop-1 ERROR [c.a.jira.startup.SystemPluginsEnabledHealthCheck] We couldn't start the follo
wing plugins:
- Jira Projects Plugin (com.atlassian.jira.jira-projects-plugin)
- Atlassian Jira - Plugins - Project Config Plugin (com.atlassian.jira.jira-project-config-plugin)
- Embedded Gadgets Plugin (com.atlassian.gadgets.embedded)
- Gadget Directory Plugin (com.atlassian.gadgets.directory)
- Atlassian Jira - Plugins - Gadgets Plugin (com.atlassian.jira.gadgets)
- Atlassian Jira - Plugins - Global Issue Navigator (com.atlassian.jira.jira-issue-nav-plugin)
- Atlassian Pretty URLs Plugin (com.atlassian.prettyurls.atlassian-pretty-urls-plugin)
- Atlassian JIRA - Plugins - Quick Edit Plugin (com.atlassian.jira.jira-quick-edit-plugin)
- Atlassian Jira - Plugins - REST Plugin (com.atlassian.jira.rest)
- Opensocial Plugin (com.atlassian.gadgets.opensocial)
- Gadget Spec Publisher Plugin (com.atlassian.gadgets.publisher)
- Gadget Dashboard Plugin (com.atlassian.gadgets.dashboard)
- Static Assets (CDN) Plugin (com.atlassian.plugins.static-assets-url)

2020-05-18 16:00:17,388+0300 localhost-startStop-1 ERROR [c.a.jira.health.HealthChecks] We haven't been able to start all the required
system plugins
2020-05-18 16:00:17,388+0300 localhost-startStop-1 ERROR [c.a.jira.health.HealthChecks] We couldn't start the following plugins:
- Jira Projects Plugin (com.atlassian.jira.jira-projects-plugin)
- Atlassian Jira - Plugins - Project Config Plugin (com.atlassian.jira.jira-project-config-plugin)
- Embedded Gadgets Plugin (com.atlassian.gadgets.embedded)
....

[Andy Heinzer]

Hi Berk,

Sorry to hear about this problem. I understand that you are unable to start this Data Center node of Jira.  Copying the plugins from another node is unlikely to help here, mostly because those plugins exist in the $JIRAHOME/plugins/ directory, but the plugins referenced in this error messages are not stored there anyways. These are actually system plugins that tend to reside within the $JIRAINSTALL/atlassian-jira/ subfolders.  Although these are called plugins, they are required for Jira to start up.

But that said, this kind of error can happen for a number of reasons.  I would suggest trying to follow Troubleshoot a Jira Server startup failed error.  Try following those steps first.  These different possible areas are the most common causes for these errors.

If you try all of those, and this is still not working, I would be interested to see if perhaps a system plugin might be flagged as disabled in the database.  You can query the SQL database to look for all disabled plugins with a statement of

select * from pluginstate;

This will return all plugins that have been disabled by an admin, or by any system process that might believe a plugin should be disabled.  I would be interested to see what results come back from that query.

It might also help to be able to take a closer look at the complete logs Jira is creating when this happens.  Sometimes we can find additional clues from looking at the $JIRAINSTALL/logs/catalina.out and the $JIRAHOME/log/atlassian-jira.log file.

Let me know.

Andy