Connector for MariaDB

[juanchistosomk]

Tell us about the problem you're trying to solve

Do not Exist connector for MARIADB :/ :/

[mrn3]

Yes! We need this!

Okay, so can't we just copy the existing MariaDB columnstore one and fix it a bit? I have run it and it had errors, so we probably just need to remove those columnstore-specific syntax things.

[mrn3]

btw, when I try to use the MySQL connector on a MariaDB database, I get errors like this:

2023-04-07 12:44:01 INFO i.a.p.j.e.LoggingJobErrorReportingClient(reportJobFailureReason):26 - Report Job Error -> workspaceId: 3d74823d-0c31-4907-80c6-e3284672eba2, dockerImage: airbyte/normalization-mysql:0.2.26, failureReason: io.airbyte.config.FailureReason@13f30a3[failureOrigin=normalization,failureType=system_error,internalMessage=1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'RETURNING CHAR) as country,,externalMessage=Normalization failed during the dbt run. This may indicate a problem with the data itself.,metadata=io.airbyte.config.Metadata@462757cb[additionalProperties={attemptNumber=2, jobId=73, from_trace_message=true}],stacktrace=AirbyteDbtError: 
1 of 1 ERROR creating table model stillwater.shop....................................................................... [ERROR in 0.13s]
Database Error in model shop (models/generated/airbyte_tables/stillwater/shop.sql)
  1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'RETURNING CHAR) as country,
      json_value(_airbyte_data, 
      '$."multi_loca...' at line 14
  compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_tables/stillwater/shop.sql
1 of 1 ERROR creating table model stillwater.shop....................................................................... [ERROR in 0.13s]
Database Error in model shop (models/generated/airbyte_tables/stillwater/shop.sql)
  1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'RETURNING CHAR) as country,
      json_value(_airbyte_data, 
      '$."multi_loca...' at line 14

In the codebase, there are references to "RETURNING CHAR":

https://github.com/airbytehq/airbyte/search?q=RETURNING+CHAR

[mrn3]

When I try to use a MariaDB Columnstore connector on a MariaDB database, in the setup, I get:

The connection tests failed.

Could not connect with provided configuration. (conn=738) Unknown storage engine 'columnstore'

[mickaelandrieu]

The old MySQL connector was able to connect to a MariaDB 11+ database, but I don't know why they have broke it without even add a notice about it ! Just wasted like 1 day to figure out Airbyte was the issue while - until I change credentials - everything was still working as expected.

And now on the Slack, you have a bot to "help you".

Possible workarounds :

• create a MySQL replica of your MariaDB database, and connect it to Airbyte
• downgrade your MariaDB database to 10