Broker restart failed

[sebplorenz]

When the broker containers were restarted the following error occured at the broker-core:

INFO: Starting Servlet engine: [Apache Tomcat/9.0.37]
Mar 24, 2022 11:42:29 AM org.apache.catalina.core.ApplicationContext log
INFO: Initializing Spring embedded WebApplicationContext
 24-03-2022 11:42:29.565 [main] INFO  org.springframework.boot.web.servlet.context.ServletWebServerApplicationContextprepareWebApplicationContext - Root WebApplicationContext: initialization completed in 3246 ms
 24-03-2022 11:42:30.769 [main] INFO  de.fraunhofer.iais.eis.ids.broker.main.MainsetUp - MobiDs Indexing enabled
 24-03-2022 11:42:30.778 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.main.AppConfigTemplatesparqlEndpointUrl - SPARQL endpoint set to http://mobids-fuseki:3030/connectorData
Starting Spring boot app
ARGS=-Djava.security.egd=file:/dev/./urandom -Dsparql.url=http://mobids-fuseki:3030/connectorData -Delasticsearch.hostname=mobids-elasticsearch  -Ddaps.validateIncoming=true -Dinfomodel.validateWithShacl=true -Dcomponent.uri=https://broker.mobilitydataspace.io -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005
Listening for transport dt_socket at address: 5005
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
 \\/  ___)| |_)| | | | | || (_| |  ) ) ) )

  '  |____| .__|_| |_|_| |_\__, | / / / /
 =========|_|==============|___/=/_/_/_/
 :: Spring Boot ::       (v2.1.16.RELEASE)
24-03-2022 12:26:12.621 [main] INFO  org.springframework.boot.StartupInfoLoggerlogStarting - Starting Main on 1d7bacf3c52f with PID 1 (/metadata-broker-core.jar started by root in /)
 24-03-2022 12:26:12.737 [main] INFO  org.springframework.boot.SpringApplicationlogStartupProfileInfo - No active profile set, falling back to default profiles: default
 24-03-2022 12:26:18.042 [main] INFO  org.springframework.boot.web.embedded.tomcat.TomcatWebServerinitialize - Tomcat initialized with port(s): 8080 (http)
Mar 24, 2022 12:26:18 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["http-nio-8080"]
Mar 24, 2022 12:26:18 PM org.apache.catalina.core.StandardService startInternal
INFO: Starting service [Tomcat]
Mar 24, 2022 12:26:18 PM org.apache.catalina.core.StandardEngine startInternal
INFO: Starting Servlet engine: [Apache Tomcat/9.0.37]
Mar 24, 2022 12:26:18 PM org.apache.catalina.core.ApplicationContext log
INFO: Initializing Spring embedded WebApplicationContext
 24-03-2022 12:26:18.484 [main] INFO  org.springframework.boot.web.servlet.context.ServletWebServerApplicationContextprepareWebApplicationContext - Root WebApplicationContext: initialization completed in 5634 ms
 24-03-2022 12:26:19.939 [main] INFO  de.fraunhofer.iais.eis.ids.broker.main.MainsetUp - MobiDs Indexing enabled
 24-03-2022 12:26:19.959 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.main.AppConfigTemplatesparqlEndpointUrl - SPARQL endpoint set to http://mobids-fuseki:3030/connectorData
 24-03-2022 12:26:19.960 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.main.AppConfigTemplatecontextDocumentUrl - Context document URL set to https://w3id.org/idsa/contexts/4.0.0/context.jsonld
 24-03-2022 12:26:19.960 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.main.AppConfigTemplatecatalogUri - Catalog URI set to https://broker.mobilitydataspace.io/connectors/
 24-03-2022 12:26:19.971 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.main.AppConfigTemplatedapsValidateIncoming - Incoming messages DAPS token verification enabled: true
 24-03-2022 12:26:19.972 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.main.AppConfigTemplateperformShaclValidation - Perform SHACL Validation is set to true
 24-03-2022 12:26:19.973 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.persistence.ElasticsearchIndexingsetDomainVocabulary - Custom Properties loaded: [mobids:transportMode,  mobids:DataCategoryDetail,  mobids:DataCategory,  mobids:geoReferenceMethod,  mobids:mdmBrokering,  mobids:nutsLocation,  mobids:roadNetworkCoverageDescription, mobids:dataFormatAdditionalDescription,  mobids:dataModel,  mobids:networkCoverage]
 24-03-2022 12:26:19.978 [main] INFO  de.fraunhofer.iais.eis.ids.component.interaction.validation.ShaclValidator<init> - Initializing SHACL shapes.
 24-03-2022 12:26:20.704 [main] INFO  de.fraunhofer.iais.eis.ids.component.interaction.validation.ShaclValidator<init> - Loading SHACL shapes from resources. You can optionally download the latest shapes from GitHub.
 24-03-2022 12:26:23.146 [main] INFO  de.fraunhofer.iais.eis.ids.component.interaction.validation.ShaclValidator<init> - Loading ontology from resources
 24-03-2022 12:26:23.339 [main] INFO  de.fraunhofer.iais.eis.ids.component.interaction.validation.ShaclValidator<init> - Initialization of SHACL shapes complete.
 24-03-2022 12:26:23.370 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.persistence.RepositoryFacade<init> - Setting SPARQL repository to be used: 'http://mobids-fuseki:3030/connectorData'
 24-03-2022 12:26:23.372 [main] INFO  de.fraunhofer.iais.eis.ids.index.common.persistence.RepositoryFacadeinitAdminGraph - Admin graph set to https://broker.ids.isst.fraunhofer.de/admin
 24-03-2022 12:26:23.825 [main] WARN  org.springframework.context.support.AbstractApplicationContextrefresh - Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'main': Invocation of init method failed; nested exception is HttpException: 503 Service Unavailable
Mar 24, 2022 12:26:23 PM org.apache.catalina.core.StandardService stopInternal
INFO: Stopping service [Tomcat]
 24-03-2022 12:26:23.872 [main] INFO  org.springframework.boot.autoconfigure.logging.ConditionEvaluationReportLoggingListenerlogMessage - 
Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
 24-03-2022 12:26:23.882 [main] ERROR org.springframework.boot.SpringApplicationreportFailure - Application run failed
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'main': Invocation of init method failed; nested exception is HttpException: 503 Service Unavailable
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:139)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:419)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1737)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:576)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:498)
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:846)
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:863)
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:546)
	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
	at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
	at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1215)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1204)
	at de.fraunhofer.iais.eis.ids.broker.main.Main.main(Main.java:187)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:52)
Caused by: org.apache.jena.sparql.engine.http.QueryExceptionHTTP: Service Unavailable
	at org.apache.jena.sparql.engine.http.HttpQuery.rewrap(HttpQuery.java:382)
	at org.apache.jena.sparql.engine.http.HttpQuery.execGet(HttpQuery.java:341)
	at org.apache.jena.sparql.engine.http.HttpQuery.exec(HttpQuery.java:293)
	at org.apache.jena.sparql.engine.http.QueryEngineHTTP.execAsk(QueryEngineHTTP.java:503)
	at org.apache.jena.rdfconnection.RDFConnectionRemote.lambda$queryAsk$4(RDFConnectionRemote.java:211)
	at org.apache.jena.system.Txn.calc(Txn.java:98)
	at org.apache.jena.system.Txn.calculateRead(Txn.java:120)
	at org.apache.jena.rdfconnection.RDFConnectionRemote.queryAsk(RDFConnectionRemote.java:209)
	at de.fraunhofer.iais.eis.ids.index.common.persistence.RepositoryFacade.booleanQuery(RepositoryFacade.java:253)
	at de.fraunhofer.iais.eis.ids.index.common.persistence.RepositoryFacade.initAdminGraph(RepositoryFacade.java:441)
	at de.fraunhofer.iais.eis.ids.index.common.persistence.RepositoryFacade.<init>(RepositoryFacade.java:71)
	at de.fraunhofer.iais.eis.ids.broker.main.AppConfig.build(AppConfig.java:64)
        at de.fraunhofer.iais.eis.ids.broker.main.Main.setUp(Main.java:142)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
	... 26 common frames omitted

After that, the broker-core halted, did not work but was also not shutting down.

Expected behaviour: If the broker-core fails to start it should exit.