Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can not download dgs_types dataset #88

Open
Tomtunn opened this issue Feb 13, 2025 · 3 comments
Open

Can not download dgs_types dataset #88

Tomtunn opened this issue Feb 13, 2025 · 3 comments

Comments

@Tomtunn
Copy link

Tomtunn commented Feb 13, 2025

This is my code

import tensorflow_datasets as tfds
import sign_language_datasets.datasets
from sign_language_datasets.datasets.config import SignDatasetConfig
import itertools

config = SignDatasetConfig(name="dgs", version="1.0.0", include_video=True, include_pose=None, process_video=False)
dgs_types = tfds.load('dgs_types', builder_kwargs=dict(config=config))

but i got his error

---------------------------------------------------------------------------
DownloadError                             Traceback (most recent call last)
Cell In[3], [line 2](vscode-notebook-cell:?execution_count=3&line=2)
      [1](vscode-notebook-cell:?execution_count=3&line=1) config = SignDatasetConfig(name="dgs", version="1.0.0", include_video=True, include_pose=None, process_video=False)
----> [2](vscode-notebook-cell:?execution_count=3&line=2) dgs_types = tfds.load('dgs_types', builder_kwargs=dict(config=config))

File c:\Users\earth\anaconda3\envs\TSL\lib\site-packages\tensorflow_datasets\core\logging\__init__.py:168, in _FunctionDecorator.__call__(self, function, instance, args, kwargs)
    [166](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/logging/__init__.py:166) metadata = self._start_call()
    [167](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/logging/__init__.py:167) try:
--> [168](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/logging/__init__.py:168)   return function(*args, **kwargs)
    [169](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/logging/__init__.py:169) except Exception:
    [170](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/logging/__init__.py:170)   metadata.mark_error()

File c:\Users\earth\anaconda3\envs\TSL\lib\site-packages\tensorflow_datasets\core\load.py:642, in load(name, split, data_dir, batch_size, shuffle_files, download, as_supervised, decoders, read_config, with_info, builder_kwargs, download_and_prepare_kwargs, as_dataset_kwargs, try_gcs)
    [523](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:523) """Loads the named dataset into a `tf.data.Dataset`.
    [524](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:524) 
    [525](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:525) `tfds.load` is a convenience method that:
   (...)
    [634](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:634)     Split-specific information is available in `ds_info.splits`.
    [635](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:635) """
    [636](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:636) dbuilder = _fetch_builder(
    [637](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:637)     name,
    [638](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:638)     data_dir,
    [639](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:639)     builder_kwargs,
    [640](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/load.py:640)     try_gcs,
...
    [333](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/download/downloader.py:333)           response.url, response.status_code
    [334](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/download/downloader.py:334)       )
    [335](file:///C:/Users/earth/anaconda3/envs/TSL/lib/site-packages/tensorflow_datasets/core/download/downloader.py:335)   )

DownloadError: Failed to get url https://www.sign-lang.uni-hamburg.de/korpusdict/clips/3252569_1.mp4. HTTP code: 404.
@AmitMY
Copy link
Contributor

AmitMY commented Feb 13, 2025

Interesting. The URLs are built through their data index page https://github.com/sign-language-processing/datasets/blob/master/sign_language_datasets/datasets/dgs_types/dgs_types.py
So I would have not expected this.
However, I too can't access this url.

Probably a temporary issue, please delete the cache and try again.

@Tomtunn
Copy link
Author

Tomtunn commented Feb 14, 2025

Do you mean delete the file in the tensorflow_datasets folder? or the cache in another location

@AmitMY
Copy link
Contributor

AmitMY commented Feb 14, 2025

deleting tensorflow_datasets/downloads usually does the job

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants