firebolt-sqlalchemy - GitLite

KO | EN

gitlite — search

#sql #awesome #cloud-native #c #python #terminal #cross-platform #git #nlp #deep-learning

firebolt-sqlalchemy

(★ 8)

The Firebolt dialect for SQLAlchemy.

File Explorer

ZIP Download

- - ci.yml
  - code-check.yml
  - integration-tests-core.yml
  - integration-tests-v1.yml
  - integration-tests-v2.yml
  - nightly-v1.yml
  - nightly-v2.yml
  - python-integration-tests.yml
  - release.yml
  - security-scan.yml
  - unit-tests.yml
- CODEOWNERS
- - __init__.py
  - firebolt_async_dialect.py
  - firebolt_dialect.py
- - CACHEDIR.TAG
  - README.md
- - __init__.py
  - conftest.py
  - test_core_integration.py
  - test_sqlalchemy_async_integration.py
  - test_sqlalchemy_integration.py
- - conftest.py
  - test_firebolt_async_dialect.py
  - test_firebolt_dialect.py
- __init__.py
.coveragerc
.fossa.yml
.gitignore
.legitignore
.pre-commit-config.yaml
ci-script.sh
CONTRIBUTING.md
LICENSE
pyproject.toml
pytest.ini
README.md
setup.cfg
sonar-project.properties

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Version

File

Link

Example

# Project Badges

Unit tests Visit
Code quality checks Visit
Firebolt Security Scan Visit
Integration tests Visit
Coverage

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<p align="center">
    <img width="761" alt="SQLAlchemy and Firebolt" src="https://user-images.githubusercontent.com/7674553/145249436-534b3cc0-2350-4f7e-9c56-78ffbcc0f003.png">
</p>

The [Firebolt](https://www.firebolt.io/) dialect for [SQLAlchemy](https://www.sqlalchemy.org/). `firebolt-sqlalchemy` uses [Firebolt's Python SDK](https://github.com/firebolt-db/firebolt-python-sdk) which implements [PEP 249](https://www.python.org/dev/peps/pep-0249/).

* [SQLAlchemy Dialects](https://docs.sqlalchemy.org/en/20/dialects/index.html#external-dialects)
* [PyPI Package](https://pypi.org/project/firebolt-sqlalchemy/)

## Installation

Requires Python >=3.7.

```bash
pip install firebolt-sqlalchemy
```

## Connecting

Connection strings use the following structure:

```
firebolt://{client_id}:{client_secret}@{database}[/{engine_name}]?account_name={name}
```

`engine_name` is optional.

`account_name` is required.

Examples:

```
firebolt://aaa-bbb-ccc-222:$ecret@sample_database?account_name=my_account
firebolt://aaa-bbb-ccc-222:$ecret@sample_database/sample_engine?account_name=my_account
```

To override the API URL (e.g. for dev testing):

```bash
export FIREBOLT_BASE_URL=<your_url>
```

If your secret contains % or / characters they need to be sanitised as per https://docs.sqlalchemy.org/en/20/core/engines.html#database-urls
```python
my_secret = "0920%/2"
import urllib.parse
new_secret = urllib.parse.quote_plus(my_secret)
```

## Connecting with Firebolt Core

[Firebolt Core](https://docs.firebolt.io/firebolt-core) is free self-hosted version of Firebolt.

In order to connect to it you can provide a simplified version of the connection string:

```
firebolt://{database}?url={url}
```

`{database}` is you Firebolt Core database. By default this is `firebolt`

`{url}` is a fully qualified URL (with port) where your Firebolt Core is hosted. By default it's `http://localhost:3473`

If you are running Firebolt Core locally with defaults the connection string will be `firebolt://firebolt?url=http://localhost:3473`

## Quick Start

```python
import urllib.parse
from sqlalchemy import create_engine

secret = urllib.parse.quote_plus("your_secret_here")
engine = create_engine("firebolt://aaa-bbb-ccc-222:" + secret + "@sample_database/sample_engine?account_name=my_account")
connection = engine.connect()

connection.execute("CREATE FACT TABLE example(dummy int) PRIMARY INDEX dummy")
connection.execute("INSERT INTO example(dummy) VALUES (11)")
result = connection.execute("SELECT * FROM example")
for item in result.fetchall():
    print(item)
```

### [AsyncIO](https://docs.sqlalchemy.org/en/20/orm/extensions/asyncio.html) extension

```python
import urllib.parse
from sqlalchemy import text
from sqlalchemy.ext.asyncio import create_async_engine

secret = urllib.parse.quote_plus("your_secret_here")
engine = create_async_engine("asyncio+firebolt://aaa-bbb-ccc-222:" + secret + "@sample_database/sample_engine?account_name=my_account")

async with engine.connect() as conn:

await conn.execute(
        text(f"INSERT INTO example(dummy) VALUES (11)")
    )

result = await conn.execute(
        text(f"SELECT * FROM example")
    )
    print(result.fetchall())

await engine.dispose()
```

## Limitations

1. Transactions are not supported right now.
1. Parametrised calls to execute and executemany are not implemented.

## Contributing

See: [CONTRIBUTING.MD](https://github.com/firebolt-db/firebolt-sqlalchemy/tree/master/CONTRIBUTING.MD)