Create Issue Exception Errors in JIRA 7.7.1 after upgrade

[Steven Spyrka]

Create Issue > click on Assignee > broken

Create Issue > click on Reporter > broken

broken means: Chrome shows a message saying "The JIRA server was contacted but has returned an error response. We are unsure of the result of this operation."

If I click the message away I see a loading animation left to the create button that loads forever.

[Andy Heinzer · Accepted solution]

Hi Steven,

What version of Jira did you upgrade from before this 7.7.1 version?

Is your instance of Jira connected to any external user directories, like Crowd, LDAP, or an Active directory site?

In my search of the error message I found in your messages so far, I came across a number of user reported cases that referenced this KB: https://confluence.atlassian.com/jirakb/jira-login-fails-with-user-exists-but-has-no-unique-key-mapping-373261121.html

I should note that so far I have not seen any stack traces from your site that indicate this would apply here yet, but considering other users that reported similar errors, I am curious if you are also seeing stack traces such as

java.lang.IllegalStateException: User 'xxxx' exists but has no unique key mapping.

If so, then I think that this KB should be followed to resolve this.

Could you generate a support zip, and then upload this to a service like google drive or dropbox, and share a link with us so we can take a closer look at the logs here.

Andy

[Steven Spyrka]

Hi Andy,

sorry for the late response.

We use an external user directory (Microsoft Active Directory (Read/Write)).

With the link below you can download the requested support.zip

https://owncloud.mcon-mannheim.de/index.php/s/jouaQRtFHCEeTE6

best regards

Steven

[Steven Spyrka]

By the way... the user christian.delarosee appears sometimes in the log but doesn't use jira. lower_user_name from cwd_user and app_user are the same.

[Andy Heinzer]

Even the latest startups of 7.10.2 still show the last successful upgrade was 7.7.1.   I see you have continued to try to upgrade Jira to 7.8 and 7.9 versions but even so we still only show an upgrade history to 7.7.1:

___ Upgrade History _______________________
    
         7.7.1#77001
              Time Performed                                : 2018-02-15 15:07:04.523
              Original Version                              : 7.4.3#74002
    
         7.4.3#74002
              Time Performed                                : 2017-08-27 23:31:36.717
              Original Version                              : 7.3.3#73011

I'm seeing this error a lot:

2018-02-15 17:09:40,305 http-nio-80-exec-19 ERROR steven.spyrka 1029x121x1 eiygfs 10.180.5.5,10.190.6.5 /rest/api/latest/user/assignable/multiProjectSearch [c.a.j.rest.exception.ExceptionInterceptor] Returning internal server error in response
java.lang.reflect.InvocationTargetException

And the caused by is always

Caused by: java.lang.IllegalStateException: User 'Christian.delaRosee' has no unique key mapping.

Which tells me there is something wrong (or unexpected by Jira) with this user's account in your Jira site.  You mentioned that this user does not use Jira, so perhaps they only exist in Jira as a user server for another application, like Confluence, or maybe they have been inactive in Jira.   But either way, there has consistently been an error in Jira that is thrown by a record for this account.

I thought at first it was possible that your instance might have been affected in the past by this bug https://jira.atlassian.com/browse/JRASERVER-63109

However this bug itself was fixed in 7.2.6.   So that shouldn't be the main cause here for any Jira versions above that version.  As such, I'd like to take a closer look at the account details for this specific user in the Jira database.   As such I think we should try to follow the work-around steps for cause #1 in https://confluence.atlassian.com/jirakb/jira-login-fails-with-user-exists-but-has-no-unique-key-mapping-373261121.html

which would have you running the following SQL queries to lookup specific data of this account:

SELECT lower_user_name
FROM cwd_user
WHERE lower_user_name NOT IN (
SELECT lower_user_name FROM app_user);

and if that does not specifically return this user account, then please also run

SELECT * FROM app_user WHERE lower_user_name = 'christian.delarosee' OR user_key = 'christian.delarosee';

It is possible there is a different value for the app_user.user_key field here.   The user_key is identical to the account's original username in Jira.  Should that user ever get renamed in Jira, the lower_user_name value will change in both tables (app_user and cwd_user), but that user_key field in the app_user table is expected to stay the same in Jira forever.   So I am curious to see if perhaps this user has multiple entries in the app_user table, or perhaps has a different user_key than expected.  Either could be a clue in regards to why Jira keeps throwing an error on this username.

[Steven Spyrka]

The first query returns christian.delarosee

 

The second returns christian.delarosée and christian.delarosee#1

[Andy Heinzer]

Hi Steven,
Thanks for this information.  If the accounts where correct in Jira, then we should not see any results to the first SQL query.  That fact that we do get a result back from that query is what we should focus on to correct this.

However the result of the second query shows two details as to why this doesn't match up:

1. The app_user.user_key has an accent mark in the name.
2. The app_user.lower_user_name value has a '#1' value appended to the string.  

This user_key can be different so I'm not worried about that, but the lower_user_name value in this table is expected to match up with the value in the cwd_user table.  Since it doesn't I think the way to fix this would be to follow these steps:

1. Stop Jira
2. Create a backup of your database first
3. Run the following SQL command to update this record:
   
   update app_user set lower_user_name="christian.delarosee" where id=13106;
   
   
4. Then start Jira again.

If we are successful, then I would expect these errors to stop happening in the Jira logs.   However that accent mark is strange for me to see, so if these steps do not correct the issue, then the next steps I would recommend would be to

1. Stop Jira
2. Create a backup of your jira database
3. run this SQL command
   
   update app_user set user_key="christian.delarosee" where id=13106;
   
   
   
4. Start Jira again

Please let me know the results.

[Steven Spyrka]

Hi Andrew,

your first query solved the problem.

update app_user set lower_user_name="christian.delarosee" where id=13106;

thanks a lot,
Steven

[Steven Spyrka]

2018-02-15 17:12:12,633 http-nio-80-exec-17 ERROR steven.spyrka 1032x133x1 eiygfs 10.180.5.5,10.190.6.5 /rest/api/latest/user/assignable/multiProjectSearch [c.a.j.rest.exception.ExceptionInterceptor] Returning internal server error in response
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.atlassian.plugins.rest.common.interceptor.impl.DispatchProviderHelper$ResponseOutInvoker$1.invoke(DispatchProviderHelper.java:192)
... 4 filtered
at com.atlassian.jira.rest.exception.ExceptionInterceptor.intercept(ExceptionInterceptor.java:55)
... 1 filtered
at com.atlassian.jira.rest.v2.issue.scope.RequestScopeInterceptor.intercept(RequestScopeInterceptor.java:39)
... 15 filtered
at com.atlassian.plugins.rest.module.RestDelegatingServletFilter$JerseyOsgiServletContainer.doFilter(RestDelegatingServletFilter.java:154)
... 1 filtered
at com.atlassian.plugins.rest.module.RestDelegatingServletFilter.doFilter(RestDelegatingServletFilter.java:68)
... 32 filtered
at com.atlassian.servicedesk.internal.web.ExternalCustomerLockoutFilter.doFilter(ExternalCustomerLockoutFilter.java:56)
... 13 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 53 filtered
at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:66)
... 1 filtered
at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:64)
... 16 filtered
at com.atlassian.plugins.rest.module.servlet.RestSeraphFilter.doFilter(RestSeraphFilter.java:37)
... 19 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 5 filtered
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.lambda$invokeFilterChain$0(CustomerContextSettingFilter.java:181)
at com.atlassian.servicedesk.internal.api.util.context.ReentrantThreadLocalBasedCodeContext.rteInvoke(ReentrantThreadLocalBasedCodeContext.java:137)
at com.atlassian.servicedesk.internal.api.util.context.ReentrantThreadLocalBasedCodeContext.runOutOfContext(ReentrantThreadLocalBasedCodeContext.java:90)
at com.atlassian.servicedesk.internal.utils.context.CustomerContextServiceImpl.runOutOfCustomerContext(CustomerContextServiceImpl.java:47)
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.outOfCustomerContext(CustomerContextSettingFilter.java:174)
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.doFilterImpl(CustomerContextSettingFilter.java:130)
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.doFilter(CustomerContextSettingFilter.java:121)
... 4 filtered
at com.atlassian.jwt.internal.servlet.JwtAuthFilter.doFilter(JwtAuthFilter.java:32)
... 8 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 4 filtered
at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
... 26 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 23 filtered
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: User 'Christian.delaRosee' has no unique key mapping.
at com.atlassian.jira.user.ApplicationUsers.from(ApplicationUsers.java:46)
at com.atlassian.jira.rest.v2.issue.UserResource.lambda$findBulkAssignableUsers$8(UserResource.java:891)
at com.google.common.collect.Iterators$7.computeNext(Iterators.java:652)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
at com.google.common.collect.Lists.newArrayList(Lists.java:160)
at com.google.common.collect.Collections2$FilteredCollection.toArray(Collections2.java:217)
at com.google.common.collect.ImmutableList.copyOf(ImmutableList.java:258)
at com.atlassian.jira.bc.user.search.IteratedSearcher.filterList(IteratedSearcher.java:75)
at com.atlassian.jira.bc.user.search.IteratedSearcher.iteratedSearch(IteratedSearcher.java:50)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.attemptFindUsersWithCrowd(DefaultUserPickerSearchService.java:222)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsersGeneric(DefaultUserPickerSearchService.java:280)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsers(DefaultUserPickerSearchService.java:256)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsers(DefaultUserPickerSearchService.java:139)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsers(DefaultUserPickerSearchService.java:130)
... 3 filtered
at java.lang.reflect.Method.invoke(Method.java:498)
at com.atlassian.plugin.util.ContextClassLoaderSettingInvocationHandler.invoke(ContextClassLoaderSettingInvocationHandler.java:26)
at com.sun.proxy.$Proxy364.findUsers(Unknown Source)
... 3 filtered
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:302)
at org.eclipse.gemini.blueprint.service.importer.support.internal.aop.ServiceInvoker.doInvoke(ServiceInvoker.java:56)
at org.eclipse.gemini.blueprint.service.importer.support.internal.aop.ServiceInvoker.invoke(ServiceInvoker.java:60)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:133)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:121)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.eclipse.gemini.blueprint.service.util.internal.aop.ServiceTCCLInterceptor.invokeUnprivileged(ServiceTCCLInterceptor.java:70)
at org.eclipse.gemini.blueprint.service.util.internal.aop.ServiceTCCLInterceptor.invoke(ServiceTCCLInterceptor.java:53)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.eclipse.gemini.blueprint.service.importer.support.LocalBundleContextAdvice.invoke(LocalBundleContextAdvice.java:57)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:133)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:121)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
at com.sun.proxy.$Proxy2855.findUsers(Unknown Source)
at com.atlassian.jira.rest.v2.issue.users.UserPickerResourceHelperImpl.findUsers(UserPickerResourceHelperImpl.java:165)
at com.atlassian.jira.rest.v2.issue.UserResource.findBulkAssignableUsers(UserResource.java:912)
... 255 more

[Josh Steckler]

Hi Steven,

Please check your logs for errors and post the error here.

-Josh

[Steven Spyrka]

2018-02-15 17:12:12,633 http-nio-80-exec-17 ERROR steven.spyrka 1032x133x1 eiygfs 10.180.5.5,10.190.6.5 /rest/api/latest/user/assignable/multiProjectSearch [c.a.j.rest.exception.ExceptionInterceptor] Returning internal server error in response
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.atlassian.plugins.rest.common.interceptor.impl.DispatchProviderHelper$ResponseOutInvoker$1.invoke(DispatchProviderHelper.java:192)
... 4 filtered
at com.atlassian.jira.rest.exception.ExceptionInterceptor.intercept(ExceptionInterceptor.java:55)
... 1 filtered
at com.atlassian.jira.rest.v2.issue.scope.RequestScopeInterceptor.intercept(RequestScopeInterceptor.java:39)
... 15 filtered
at com.atlassian.plugins.rest.module.RestDelegatingServletFilter$JerseyOsgiServletContainer.doFilter(RestDelegatingServletFilter.java:154)
... 1 filtered
at com.atlassian.plugins.rest.module.RestDelegatingServletFilter.doFilter(RestDelegatingServletFilter.java:68)
... 32 filtered
at com.atlassian.servicedesk.internal.web.ExternalCustomerLockoutFilter.doFilter(ExternalCustomerLockoutFilter.java:56)
... 13 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 53 filtered
at com.atlassian.jira.security.JiraSecurityFilter.lambda$doFilter$0(JiraSecurityFilter.java:66)
... 1 filtered
at com.atlassian.jira.security.JiraSecurityFilter.doFilter(JiraSecurityFilter.java:64)
... 16 filtered
at com.atlassian.plugins.rest.module.servlet.RestSeraphFilter.doFilter(RestSeraphFilter.java:37)
... 19 filtered
at com.atlassian.jira.servermetrics.CorrelationIdPopulatorFilter.doFilter(CorrelationIdPopulatorFilter.java:30)
... 5 filtered
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.lambda$invokeFilterChain$0(CustomerContextSettingFilter.java:181)
at com.atlassian.servicedesk.internal.api.util.context.ReentrantThreadLocalBasedCodeContext.rteInvoke(ReentrantThreadLocalBasedCodeContext.java:137)
at com.atlassian.servicedesk.internal.api.util.context.ReentrantThreadLocalBasedCodeContext.runOutOfContext(ReentrantThreadLocalBasedCodeContext.java:90)
at com.atlassian.servicedesk.internal.utils.context.CustomerContextServiceImpl.runOutOfCustomerContext(CustomerContextServiceImpl.java:47)
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.outOfCustomerContext(CustomerContextSettingFilter.java:174)
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.doFilterImpl(CustomerContextSettingFilter.java:130)
at com.atlassian.servicedesk.internal.web.CustomerContextSettingFilter.doFilter(CustomerContextSettingFilter.java:121)
... 4 filtered
at com.atlassian.jwt.internal.servlet.JwtAuthFilter.doFilter(JwtAuthFilter.java:32)
... 8 filtered
at com.atlassian.web.servlet.plugin.request.RedirectInterceptingFilter.doFilter(RedirectInterceptingFilter.java:21)
... 4 filtered
at com.atlassian.web.servlet.plugin.LocationCleanerFilter.doFilter(LocationCleanerFilter.java:36)
... 26 filtered
at com.atlassian.jira.servermetrics.MetricsCollectorFilter.doFilter(MetricsCollectorFilter.java:25)
... 23 filtered
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: User 'Christian.delaRosee' has no unique key mapping.
at com.atlassian.jira.user.ApplicationUsers.from(ApplicationUsers.java:46)
at com.atlassian.jira.rest.v2.issue.UserResource.lambda$findBulkAssignableUsers$8(UserResource.java:891)
at com.google.common.collect.Iterators$7.computeNext(Iterators.java:652)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
at com.google.common.collect.Lists.newArrayList(Lists.java:160)
at com.google.common.collect.Collections2$FilteredCollection.toArray(Collections2.java:217)
at com.google.common.collect.ImmutableList.copyOf(ImmutableList.java:258)
at com.atlassian.jira.bc.user.search.IteratedSearcher.filterList(IteratedSearcher.java:75)
at com.atlassian.jira.bc.user.search.IteratedSearcher.iteratedSearch(IteratedSearcher.java:50)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.attemptFindUsersWithCrowd(DefaultUserPickerSearchService.java:222)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsersGeneric(DefaultUserPickerSearchService.java:280)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsers(DefaultUserPickerSearchService.java:256)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsers(DefaultUserPickerSearchService.java:139)
at com.atlassian.jira.bc.user.search.DefaultUserPickerSearchService.findUsers(DefaultUserPickerSearchService.java:130)
... 3 filtered
at java.lang.reflect.Method.invoke(Method.java:498)
at com.atlassian.plugin.util.ContextClassLoaderSettingInvocationHandler.invoke(ContextClassLoaderSettingInvocationHandler.java:26)
at com.sun.proxy.$Proxy364.findUsers(Unknown Source)
... 3 filtered
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:302)
at org.eclipse.gemini.blueprint.service.importer.support.internal.aop.ServiceInvoker.doInvoke(ServiceInvoker.java:56)
at org.eclipse.gemini.blueprint.service.importer.support.internal.aop.ServiceInvoker.invoke(ServiceInvoker.java:60)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:133)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:121)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.eclipse.gemini.blueprint.service.util.internal.aop.ServiceTCCLInterceptor.invokeUnprivileged(ServiceTCCLInterceptor.java:70)
at org.eclipse.gemini.blueprint.service.util.internal.aop.ServiceTCCLInterceptor.invoke(ServiceTCCLInterceptor.java:53)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.eclipse.gemini.blueprint.service.importer.support.LocalBundleContextAdvice.invoke(LocalBundleContextAdvice.java:57)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:133)
at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:121)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
at com.sun.proxy.$Proxy2855.findUsers(Unknown Source)
at com.atlassian.jira.rest.v2.issue.users.UserPickerResourceHelperImpl.findUsers(UserPickerResourceHelperImpl.java:165)
at com.atlassian.jira.rest.v2.issue.UserResource.findBulkAssignableUsers(UserResource.java:912)
... 255 more