Using Devservices To Execute Tests With Consistent Data #43165

tylernielson1 · 2024-09-09T23:02:37Z

tylernielson1
Sep 9, 2024

Hello,

I'm working on implementing a new gRPC service in Quarkus and I'm running into a bit of an issue. I'm currently trying to utilize Devservices to create a database container for me to execute tests against. I have got the startup working correctly and can use the root credentials to connect to the MySQL Docker container that Quarkus spins up. I know that Quarkus defaults to using quarkus as both the username and password for the MySQL image, but when I try to use those credentials I'm unable to do anything in the container. Those credentials appear to have no permissions. Is there a way I can grant those permissions so I can use the default username and password instead of the root credentials?

Some additional details or clarification: I'm hoping to execute the test suite of the application against this docker container, so I have an SQL script that creates the database and tables needed for those tests. If I start the application with the root credentials provided in the properties file, no issues. If I try to provide the default quarkus credentials, it blows up and fails to start.

Thanks!

Answered by tylernielson1

Sep 10, 2024

Removing the create database statement and declaring the create table statements without a specified database works just fine. So it would appear that creating the database is my issue.

View full answer

@geoand · 2024-09-09T23:02:40Z

quarkus-bot[bot]
bot Sep 9, 2024

/cc @geoand (devservices), @stuartwdouglas (devservices)

0 replies

geoand · 2024-09-10T05:35:26Z

geoand
Sep 10, 2024
Collaborator

cc @yrodiere

0 replies

yrodiere · 2024-09-10T07:06:16Z

yrodiere
Sep 10, 2024
Collaborator

Hello.

I'm not sure what you are doing exactly, so I'm afraid I'm going to need an example project (reproducer).

All I can do at this point is point out there is a built-in property to have an SQL script executed on container startup: quarkus.datasource.devservices.init-script-path

6 replies

tylernielson1 Sep 10, 2024
Author

Sure. I've attached an example import.sql and the log output that displays during the start up.

import.sql

create database foo;

create table if not exists foo.bar(
id int unsigned auto_increment primary key,
field1 varchar(255) not null
);

create table if not exists foo.baz(
id int unsigned auto_increment primary key,
field1 tinyint(1) default 1 not null,
bar_id int unsigned not null,
constraint bar_id_foreign_key
foreign key (bar_id) references foo.bar (id)
);

insert into foo.bar(field1)
values('test');

insert into foo.baz(bar_id)
values(1);

Log Output

2024-09-10 11:07:46,931 ERROR [io.qua.dep.dev.IsolatedDevModeMain] (vert.x-worker-thread-1) Failed to start quarkus: java.lang.RuntimeException: io.quarkus.builder.BuildException: Build failure: Build failed due to errors [error]: Build step io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor#launchDatabases threw an exception: java.lang.RuntimeException: org.testcontainers.containers.ContainerLaunchException: Container startup failed for image docker.io/mysql:8.0 at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:362) at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.launchDatabases(DevServicesDatasourceProcessor.java:142) at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103) at java.base/java.lang.reflect.Method.invoke(Method.java:580) at io.quarkus.deployment.ExtensionLoader$3.execute(ExtensionLoader.java:849) at io.quarkus.builder.BuildContext.run(BuildContext.java:256) at org.jboss.threads.ContextHandler$1.runWith(ContextHandler.java:18) at org.jboss.threads.EnhancedQueueExecutor$Task.doRunWith(EnhancedQueueExecutor.java:2516) at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2495) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1521) at java.base/java.lang.Thread.run(Thread.java:1570) at org.jboss.threads.JBossThread.run(JBossThread.java:483) Caused by: org.testcontainers.containers.ContainerLaunchException: Container startup failed for image docker.io/mysql:8.0 at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:359) at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:330) at io.quarkus.devservices.mysql.deployment.MySQLDevServicesProcessor$1.startDatabase(MySQLDevServicesProcessor.java:77) at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:288) ... 11 more Caused by: org.rnorth.ducttape.RetryCountExceededException: Retry limit hit with exception at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:88) at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:344) ... 14 more Caused by: org.testcontainers.containers.ContainerLaunchException: Could not create/start container at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:563) at org.testcontainers.containers.GenericContainer.lambda$doStart$0(GenericContainer.java:354) at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:81) ... 15 more Caused by: org.testcontainers.ext.ScriptUtils$UncategorizedScriptException: Failed to execute database script from resource [create database foo;

create table if not exists foo.bar(
id int unsigned auto_increment primary key,
field1 varchar(255) not null
);

create table if not exists foo.baz(
id int unsigned auto_increment primary key,
field1 tinyint(1) default 1 not null,
bar_id int unsigned not null,
constraint bar_id_foreign_key
foreign key (bar_id) references foo.bar (id)
);

insert into foo.bar(field1)
values('test');

insert into foo.baz(field1, bar_id)
values('test field', 1);]
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:319)
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:225)
at org.testcontainers.ext.ScriptUtils.runInitScript(ScriptUtils.java:213)
at org.testcontainers.containers.JdbcDatabaseContainer.runInitScriptIfRequired(JdbcDatabaseContainer.java:333)
at org.testcontainers.containers.JdbcDatabaseContainer.containerIsStarted(JdbcDatabaseContainer.java:188)
at org.testcontainers.containers.GenericContainer.containerIsStarted(GenericContainer.java:721)
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:542)
... 17 more
Caused by: org.testcontainers.ext.ScriptUtils$ScriptStatementFailedException: Script execution failed (import.sql:1): create database foo
at org.testcontainers.jdbc.JdbcDatabaseDelegate.execute(JdbcDatabaseDelegate.java:59)
at org.testcontainers.delegate.AbstractDatabaseDelegate.execute(AbstractDatabaseDelegate.java:38)
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:307)
... 23 more
Caused by: java.sql.SQLSyntaxErrorException: Access denied for user 'quarkus'@'%' to database 'foo'
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:121)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:770)
at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:653)
at org.testcontainers.jdbc.JdbcDatabaseDelegate.execute(JdbcDatabaseDelegate.java:46)
... 25 more

    at io.quarkus.runner.bootstrap.AugmentActionImpl.runAugment(AugmentActionImpl.java:331)
    at io.quarkus.runner.bootstrap.AugmentActionImpl.reloadExistingApplication(AugmentActionImpl.java:265)
    at io.quarkus.runner.bootstrap.AugmentActionImpl.reloadExistingApplication(AugmentActionImpl.java:58)
    at io.quarkus.deployment.dev.IsolatedDevModeMain.restartApp(IsolatedDevModeMain.java:191)
    at io.quarkus.deployment.dev.IsolatedDevModeMain.restartCallback(IsolatedDevModeMain.java:174)
    at io.quarkus.deployment.dev.RuntimeUpdatesProcessor.doScan(RuntimeUpdatesProcessor.java:548)
    at io.quarkus.deployment.dev.RuntimeUpdatesProcessor.doScan(RuntimeUpdatesProcessor.java:448)
    at io.quarkus.vertx.http.runtime.devmode.VertxHttpHotReplacementSetup$6.call(VertxHttpHotReplacementSetup.java:161)
    at io.quarkus.vertx.http.runtime.devmode.VertxHttpHotReplacementSetup$6.call(VertxHttpHotReplacementSetup.java:148)
    at io.vertx.core.impl.ContextImpl.lambda$executeBlocking$0(ContextImpl.java:178)
    at io.vertx.core.impl.ContextInternal.dispatch(ContextInternal.java:279)
    at io.vertx.core.impl.ContextImpl.lambda$internalExecuteBlocking$2(ContextImpl.java:210)
    at org.jboss.threads.ContextHandler$1.runWith(ContextHandler.java:18)
    at org.jboss.threads.EnhancedQueueExecutor$Task.doRunWith(EnhancedQueueExecutor.java:2516)
    at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2495)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1521)
    at org.jboss.threads.DelegatingRunnable.run(DelegatingRunnable.java:11)
    at org.jboss.threads.ThreadLocalResettingRunnable.run(ThreadLocalResettingRunnable.java:11)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    at java.base/java.lang.Thread.run(Thread.java:1570)

Caused by: io.quarkus.builder.BuildException: Build failure: Build failed due to errors
[error]: Build step io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor#launchDatabases threw an exception: java.lang.RuntimeException: org.testcontainers.containers.ContainerLaunchException: Container startup failed for image docker.io/mysql:8.0
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:362)
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.launchDatabases(DevServicesDatasourceProcessor.java:142)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at io.quarkus.deployment.ExtensionLoader$3.execute(ExtensionLoader.java:849)
at io.quarkus.builder.BuildContext.run(BuildContext.java:256)
at org.jboss.threads.ContextHandler$1.runWith(ContextHandler.java:18)
at org.jboss.threads.EnhancedQueueExecutor$Task.doRunWith(EnhancedQueueExecutor.ja)a:2516
at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2495)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1521)
at java.base/java.lang.Thread.run(Thread.java:1570)
at org.jboss.threads.JBossThread.run(JBossThread.java:483)
Caused by: org.testcontainers.containers.ContainerLaunchException: Container startup failed for image docker.io/mysql:8.0
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:359)
at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:330)
at io.quarkus.devservices.mysql.deployment.MySQLDevServicesProcessor$1.startDatabase(MySQLDevServicesProcessor.java:77)
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:288)
... 11 more
Caused by: org.rnorth.ducttape.RetryCountExceededException: Retry limit hit with exception
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:88)
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:344)
... 14 more
Caused by: org.testcontainers.containers.ContainerLaunchException: Could not create/start container
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:563)
at org.testcontainers.containers.GenericContainer.lambda$doStart$0(GenericContainer.java:354)
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:81)
... 15 more
Caused by: org.testcontainers.ext.ScriptUtils$UncategorizedScriptException: Failed to execute database script from resource [create database foo;

create table if not exists foo.bar(
id int unsigned auto_increment primary key,
field1 varchar(255) not null
);

create table if not exists foo.baz(
id int unsigned auto_increment primary key,
field1 tinyint(1) default 1 not null,
bar_id int unsigned not null,
constraint bar_id_foreign_key
foreign key (bar_id) references foo.bar (id)
);

insert into foo.bar(field1)
values('test');

insert into foo.baz(field1, bar_id)
values('test field', 1);]
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:319)
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:225)
at org.testcontainers.ext.ScriptUtils.runInitScript(ScriptUtils.java:213)
at org.testcontainers.containers.JdbcDatabaseContainer.runInitScriptIfRequired(JdbcDatabaseContainer.java:333)
at org.testcontainers.containers.JdbcDatabaseContainer.containerIsStarted(JdbcDatabaseContainer.java:188)
at org.testcontainers.containers.GenericContainer.containerIsStarted(GenericContainer.java:721)
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:542)
... 17 more
Caused by: org.testcontainers.ext.ScriptUtils$ScriptStatementFailedException: Script execution failed (import.sql:1): create database foo
at org.testcontainers.jdbc.JdbcDatabaseDelegate.execute(JdbcDatabaseDelegate.java:59)
at org.testcontainers.delegate.AbstractDatabaseDelegate.execute(AbstractDatabaseDelegate.java:38)
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:307)
... 23 more
Caused by: java.sql.SQLSyntaxErrorException: Access denied for user 'quarkus'@'%' to database 'foo'
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:121)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:770)
at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:653)
at org.testcontainers.jdbc.JdbcDatabaseDelegate.execute(JdbcDatabaseDelegate.java:46)
... 25 more

    at io.quarkus.builder.Execution.run(Execution.java:123)
    at io.quarkus.builder.BuildExecutionBuilder.execute(BuildExecutionBuilder.java:79)
    at io.quarkus.deployment.QuarkusAugmentor.run(QuarkusAugmentor.java:160)
    at io.quarkus.runner.bootstrap.AugmentActionImpl.runAugment(AugmentActionImpl.java:327)
    ... 19 more

Caused by: java.lang.RuntimeException: org.testcontainers.containers.ContainerLaunchException: Container startup failed for image docker.io/mysql:8.0
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:362)
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.launchDatabases(DevServicesDatasourceProcessor.java:142)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at io.quarkus.deployment.ExtensionLoader$3.execute(ExtensionLoader.java:849)
at io.quarkus.builder.BuildContext.run(BuildContext.java:256)
at org.jboss.threads.ContextHandler$1.runWith(ContextHandler.java:18)
at org.jboss.threads.EnhancedQueueExecutor$Task.doRunWith(EnhancedQueueExecutor.java:2516)
at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2495)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1521)
at java.base/java.lang.Thread.run(Thread.java:1570)
at org.jboss.threads.JBossThread.run(JBossThread.java:483)
Caused by: org.testcontainers.containers.ContainerLaunchException: Container startup failed for image docker.io/mysql:8.0
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:359)
at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:330)
at io.quarkus.devservices.mysql.deployment.MySQLDevServicesProcessor$1.startDatabase(MySQLDevServicesProcessor.java:77)
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:288)
... 11 more
Caused by: org.rnorth.ducttape.RetryCountExceededException: Retry limit hit with exception
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:88)
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:344)
... 14 more
Caused by: org.testcontainers.containers.ContainerLaunchException: Could not create/start container
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:563)
at org.testcontainers.containers.GenericContainer.lambda$doStart$0(GenericContainer.java:354)
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:81)
... 15 more
Caused by: org.testcontainers.ext.ScriptUtils$UncategorizedScriptException: Failed to execute database script from resource [create database foo;

create table if not exists foo.bar(
id int unsigned auto_increment primary key,
field1 varchar(255) not null
);

create table if not exists foo.baz(
id int unsigned auto_increment primary key,
field1 tinyint(1) default 1 not null,
bar_id int unsigned not null,
constraint bar_id_foreign_key
foreign key (bar_id) references foo.bar (id)
);

insert into foo.bar(field1)
values('test');

insert into foo.baz(field1, bar_id)
values('test field', 1);]
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:319)
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:225)
at org.testcontainers.ext.ScriptUtils.runInitScript(ScriptUtils.java:213)
at org.testcontainers.containers.JdbcDatabaseContainer.runInitScriptIfRequired(JdbcDatabaseContainer.java:333)
at org.testcontainers.containers.JdbcDatabaseContainer.containerIsStarted(JdbcDatabaseContainer.java:188)
at org.testcontainers.containers.GenericContainer.containerIsStarted(GenericContainer.java:721)
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:542)
... 17 more
Caused by: org.testcontainers.ext.ScriptUtils$ScriptStatementFailedException: Script execution failed (import.sql:1): create database foo
at org.testcontainers.jdbc.JdbcDatabaseDelegate.execute(JdbcDatabaseDelegate.java:59)
at org.testcontainers.delegate.AbstractDatabaseDelegate.execute(AbstractDatabaseDelegate.java:38)
at org.testcontainers.ext.ScriptUtils.executeDatabaseScript(ScriptUtils.java:307)
... 23 more
Caused by: java.sql.SQLSyntaxErrorException: Access denied for user 'quarkus'@'%' to database 'foo'
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:121)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:770)
at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:653)
at org.testcontainers.jdbc.JdbcDatabaseDelegate.execute(JdbcDatabaseDelegate.java:46)
... 25 more

tylernielson1 Sep 10, 2024
Author

Ah, I'm now realizing it may be due to me trying to create a new database. Is there a workaround to that?

yrodiere Sep 10, 2024
Collaborator

Ah, I'm now realizing it may be due to me trying to create a new database.

Most likely, yes.

Is there a workaround to that?

This touches more to DBA knowledge than Quarkus...

If it's the create database statement failing, you probably need to use root somehow; maybe temporarily switch to root user in the script: the password should be quarkus too.

If it's the create table statement, failing, I imagine you need to GRANT the quarkus user access to the database.

tylernielson1 Sep 10, 2024
Author

Removing the create database statement and declaring the create table statements without a specified database works just fine. So it would appear that creating the database is my issue.

Answer selected by yrodiere

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Using Devservices To Execute Tests With Consistent Data #43165

{{title}}

Replies: 3 comments 6 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

Using Devservices To Execute Tests With Consistent Data #43165

tylernielson1 Sep 9, 2024

Replies: 3 comments · 6 replies

quarkus-bot[bot] bot Sep 9, 2024

geoand Sep 10, 2024 Collaborator

yrodiere Sep 10, 2024 Collaborator

tylernielson1 Sep 10, 2024 Author

tylernielson1 Sep 10, 2024 Author

yrodiere Sep 10, 2024 Collaborator

tylernielson1 Sep 10, 2024 Author

tylernielson1
Sep 9, 2024

Replies: 3 comments 6 replies

quarkus-bot[bot]
bot Sep 9, 2024

geoand
Sep 10, 2024
Collaborator

yrodiere
Sep 10, 2024
Collaborator

tylernielson1 Sep 10, 2024
Author

tylernielson1 Sep 10, 2024
Author

yrodiere Sep 10, 2024
Collaborator

tylernielson1 Sep 10, 2024
Author