You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
DuckDB currently implements a secret manager. To connect to a Delta table on S3/MINIO using DuckDB, the supported secrets must be configured using the CREATE SECRET command within DuckDB, and cannot be set through the SET S3 config method. Therefore, the config set in pre_config is not usable, and the information in the config needs to be specified using the CREATE SECRET (TYPE S3...) method. It is hoped that this can be handled through "Preloading extensions" before establishing the connection.
What happened?
DuckDB currently implements a secret manager. To connect to a Delta table on S3/MINIO using DuckDB, the supported secrets must be configured using the CREATE SECRET command within DuckDB, and cannot be set through the SET S3 config method. Therefore, the config set in pre_config is not usable, and the information in the config needs to be specified using the CREATE SECRET (TYPE S3...) method. It is hoped that this can be handled through "Preloading extensions" before establishing the connection.
Normally run within duckdb
`install "delta";
load 'delta';
CREATE SECRET (TYPE S3, REGION 'my-region', ENDPOINT 'minio.com', KEY_ID 'user', SECRET 'stringsOOXX', USE_SSL false);
SELECT * FROM delta_scan('s3://path/to/delta');`
Must use "create secret" with delta extension
DuckDB Engine Version
0.14.0
DuckDB Version
1.1.3
SQLAlchemy Version
1.4.54
Relevant log output
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: