Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Process hung when downloading model #2483

Open
kiranchitturi opened this issue Aug 23, 2024 · 0 comments
Open

Process hung when downloading model #2483

kiranchitturi opened this issue Aug 23, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@kiranchitturi
Copy link

Describe the bug

HuggingFace is using TQDM and it is causing the process to hang indefinitely. Are there any library conflicts that could be causing this? How can I get around this error?

Reproduction

No response

Logs

{"event": "PyTorch version 2.1.2 available.", "logger": "datasets", "timestamp": "2024-08-23T00:43:27.482936Z", "level": "info"}
Thread 0x0000000304556000 (most recent call first):
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/threading.py", line 324 in wait
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/threading.py", line 600 in wait
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/threading.py", line 1356 in run
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/threading.py", line 1009 in _bootstrap_inner
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/threading.py", line 966 in _bootstrap

Current thread 0x0000000200933240 (most recent call first):
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/multiprocessing/util.py", line 452 in spawnv_passfds
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/multiprocessing/resource_tracker.py", line 129 in ensure_running
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/multiprocessing/resource_tracker.py", line 162 in _send
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/multiprocessing/resource_tracker.py", line 155 in register
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/multiprocessing/synchronize.py", line 80 in __init__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/multiprocessing/synchronize.py", line 187 in __init__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/multiprocessing/context.py", line 73 in RLock
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/tqdm/std.py", line 121 in create_mp_lock
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/tqdm/std.py", line 97 in __init__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/tqdm/std.py", line 764 in get_lock
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/tqdm/contrib/concurrent.py", line 19 in ensure_lock
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/contextlib.py", line 135 in __enter__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/tqdm/contrib/concurrent.py", line 47 in _executor_map
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/tqdm/contrib/concurrent.py", line 69 in thread_map
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 308 in snapshot_download
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 118 in _inner_fn
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/FlagEmbedding/BGE_M3/modeling.py", line 72 in load_model
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/FlagEmbedding/BGE_M3/modeling.py", line 40 in __init__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/FlagEmbedding/bge_m3.py", line 36 in __init__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/milvus_model/hybrid/bge_m3.py", line 60 in __init__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/milvus_model/hybrid/__init__.py", line 9 in BGEM3EmbeddingFunction
  File "/Users/kiranchitturi/dev/git/PROJECT_DIR/app/pages/script.py", line 31 in get_bge_m3_embedding_function
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/streamlit/runtime/caching/cache_utils.py", line 322 in _handle_cache_miss
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/streamlit/runtime/caching/cache_utils.py", line 266 in _get_or_create_cached_value
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/streamlit/runtime/caching/cache_utils.py", line 239 in __call__
  File "/Users/kiranchitturi/opt/miniconda3/envs/conda_env2/lib/python3.10/site-packages/streamlit/runtime/caching/cache_utils.py", line 210 in wrapper
  File "/Users/kiranchitturi/dev/git/PROJECT_DIR/app/pages/script.py", line 47 in <module>


### System info

```shell
- huggingface_hub version: 0.20.1
- Platform: macOS-10.16-x86_64-i386-64bit
- Python version: 3.10.0
- Running in iPython ?: No
- Running in notebook ?: No
- Running in Google Colab ?: No
- Token path ?: /Users/kiranchitturi/.cache/huggingface/token
- Has saved token ?: False
- Configured git credential helpers: osxkeychain
- FastAI: N/A
- Tensorflow: N/A
- Torch: 2.1.2
- Jinja2: 3.1.2
- Graphviz: N/A
- Pydot: N/A
- Pillow: 10.1.0
- hf_transfer: N/A
- gradio: N/A
- tensorboard: N/A
- numpy: 1.26.2
- pydantic: 2.5.3
- aiohttp: 3.10.5
- ENDPOINT: https://huggingface.co
- HF_HUB_CACHE: /Users/kiranchitturi/.cache/huggingface/hub
- HF_ASSETS_CACHE: /Users/kiranchitturi/.cache/huggingface/assets
- HF_TOKEN_PATH: /Users/kiranchitturi/.cache/huggingface/token
- HF_HUB_OFFLINE: False
- HF_HUB_DISABLE_TELEMETRY: False
- HF_HUB_DISABLE_PROGRESS_BARS: None
- HF_HUB_DISABLE_SYMLINKS_WARNING: False
- HF_HUB_DISABLE_EXPERIMENTAL_WARNING: False
- HF_HUB_DISABLE_IMPLICIT_TOKEN: False
- HF_HUB_ENABLE_HF_TRANSFER: False
- HF_HUB_ETAG_TIMEOUT: 10
- HF_HUB_DOWNLOAD_TIMEOUT: 10
@kiranchitturi kiranchitturi added the bug Something isn't working label Aug 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant