Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: add CREATE SECRET confiig for delta extension supported #1192

Open
1 task done
ivanonair opened this issue Jan 7, 2025 · 0 comments
Open
1 task done
Assignees
Labels
bug Something isn't working

Comments

@ivanonair
Copy link

ivanonair commented Jan 7, 2025

What happened?

DuckDB currently implements a secret manager. To connect to a Delta table on S3/MINIO using DuckDB, the supported secrets must be configured using the CREATE SECRET command within DuckDB, and cannot be set through the SET S3 config method. Therefore, the config set in pre_config is not usable, and the information in the config needs to be specified using the CREATE SECRET (TYPE S3...) method. It is hoped that this can be handled through "Preloading extensions" before establishing the connection.

Normally run within duckdb
`install "delta";

load 'delta';

CREATE SECRET (TYPE S3, REGION 'my-region', ENDPOINT 'minio.com', KEY_ID 'user', SECRET 'stringsOOXX', USE_SSL false);

SELECT * FROM delta_scan('s3://path/to/delta');`

Must use "create secret" with delta extension

DuckDB Engine Version

0.14.0

DuckDB Version

1.1.3

SQLAlchemy Version

1.4.54

Relevant log output

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@ivanonair ivanonair added the bug Something isn't working label Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants