Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix database existence check #463

Open
wants to merge 14 commits into
base: master
Choose a base branch
from
Open

fix database existence check #463

Changes from 7 commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
6e11f3f
fix database existence check
bernt-matthias Jul 9, 2020
36e765b
always dispose engine after db existence check
bernt-matthias Jul 9, 2020
743aa21
add docs for postgres_db parameter
bernt-matthias Jul 9, 2020
15dc668
fix dialect_name
bernt-matthias Jul 9, 2020
527b885
optimize execution order
bernt-matthias Jul 9, 2020
37bb37b
database_exists fix return
bernt-matthias Jul 15, 2020
4b396d8
Merge branch 'topic/372-followup' of https://github.com/bernt-matthia…
bernt-matthias Jul 15, 2020
6dd16e7
use None as default
bernt-matthias Jul 15, 2020
7e41e85
break if successful
bernt-matthias Jul 15, 2020
e481582
dispose only for exception
bernt-matthias Jul 15, 2020
74b3513
use Null connection pool and close connections
bernt-matthias Jul 16, 2020
acb681c
fix isort call in tox.ini and import order
bernt-matthias Jul 16, 2020
7908606
rename parameter to databases
bernt-matthias Jul 28, 2020
f509f38
move functions to module level
bernt-matthias Jul 29, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
50 changes: 32 additions & 18 deletions sqlalchemy_utils/functions/database.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -420,10 +420,13 @@ def is_auto_assigned_date_column(column):
)


def database_exists(url):
def database_exists(url, postgres_db=('postgres', 'template0', 'template1',
None)):
bernt-matthias marked this conversation as resolved.
Show resolved Hide resolved
"""Check if a database exists.

:param url: A SQLAlchemy engine URL.
:postgres_db: Only applies to postgres. List of databases to try to connect
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do this parameter apply to any other databases? In other words does for example Oracle or MSSQL have similar things that a default database should be provided in order to check the existence of another database. If so, we should use some different naming for this.

Furthermore the description of the parameter suggests this parameter is a list of values but the name does not. Either the parameter should be named postgres_databases (or something similar) OR this parameter could be string.

I'm leaning towards the latter option as the end user who is using this function should know which default database to use and just provide that as a string parameter for this function.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do this parameter apply to any other databases?

I have no idea. But it seems to be postgres specific (I also found no issue that indicates such a problem for other databases). Still - if desired - I could change the parameter name to databases and indicate in the docs that it currently only applies to postgres.

Furthermore the description of the parameter suggests this parameter is a list of values but the name does not.

I would go for postgres_databases. The list has the advantage will work for many settings automatically.

to.

Performs backend-specific testing to quickly determine if a database
exists on the server. ::
Expand Down Expand Up @@ -459,41 +462,52 @@ def sqlite_file_exists(database):

url = copy(make_url(url))
database, url.database = url.database, None
engine = sa.create_engine(url)
engine = None
dialect_name = url.get_dialect().name

if engine.dialect.name == 'postgresql':
if dialect_name == 'postgresql':
ret = False
text = "SELECT 1 FROM pg_database WHERE datname='%s'" % database
return bool(get_scalar_result(engine, text))

elif engine.dialect.name == 'mysql':
for pdb in postgres_db:
bernt-matthias marked this conversation as resolved.
Show resolved Hide resolved
url.database = pdb
engine = sa.create_engine(url)
try:
ret = bool(get_scalar_result(engine, text))
except (ProgrammingError, OperationalError):
pass
engine.dispose()
bernt-matthias marked this conversation as resolved.
Show resolved Hide resolved
if ret:
return ret
bernt-matthias marked this conversation as resolved.
Show resolved Hide resolved

elif dialect_name == 'mysql':
engine = sa.create_engine(url)
text = ("SELECT SCHEMA_NAME FROM INFORMATION_SCHEMA.SCHEMATA "
"WHERE SCHEMA_NAME = '%s'" % database)
return bool(get_scalar_result(engine, text))
ret = bool(get_scalar_result(engine, text))

elif engine.dialect.name == 'sqlite':
elif dialect_name == 'sqlite':
engine = sa.create_engine(url)
if database:
return database == ':memory:' or sqlite_file_exists(database)
ret = database == ':memory:' or sqlite_file_exists(database)
else:
# The default SQLAlchemy database is in memory,
# and :memory is not required, thus we should support that use-case
return True

ret = True
else:
engine.dispose()
engine = None
text = 'SELECT 1'
try:
url.database = database
engine = sa.create_engine(url)
result = engine.execute(text)
result.close()
return True
ret = True

except (ProgrammingError, OperationalError):
return False
finally:
if engine is not None:
engine.dispose()
ret = False

if engine is not None:
engine.dispose()
return ret


def create_database(url, encoding='utf8', template=None):
Expand Down