No project description provided
Project description
HF Transfer
Speed up file transfers with the Hub.
DISCLAIMER
This library is a power user tool, to go beyond ~500MB/s
on very high bandwidth
network, where Python cannot cap out the available bandwidth.
This is not meant to be a general usability tool. It purposefully lacks progressbars and comes generally as-is.
Please file issues only if there's an issue on the underlying downloaded file.
Contributing
python3 -m venv ~/.venv/hf_transfer
source ~/.venv/hf_transfer/bin/activate
pip install maturin
maturin develop
huggingface_hub
If you are working on changes with huggingface_hub
git clone git@github.com:huggingface/huggingface_hub.git
# git clone https://github.com/huggingface/huggingface_hub.git
cd huggingface_hub
python3 -m pip install -e ".[quality]"
You can use the following test script:
import os
# os.environ["HF_ENDPOINT"] = "http://localhost:5564"
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"
from huggingface_hub import HfApi, logging
logging.set_verbosity_debug()
hf = HfApi()
hf.upload_file(path_or_fileobj="/path/to/my/repo/some_file", path_in_repo="some_file", repo_id="my/repo", repo_type="model")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
File details
Details for the file hf_transfer-0.1.4.tar.gz
.
File metadata
- Download URL: hf_transfer-0.1.4.tar.gz
- Upload date:
- Size: 20.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 687e090639cd52a48dedbfaa9e455a2c99c5169ece3d911f95983b1d4d4c84ed |
|
MD5 | 1f0ba5f65938a7ea5de1c1c962a522d2 |
|
BLAKE2b-256 | 5dc26736069e3e42c14259bf263b682ddcff8ef0e1a3c5c5af4dc2b907d66759 |
File details
Details for the file hf_transfer-0.1.4-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: PyPy, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1a466ae2b11d72df9e0005eb8ff7f537d5460c98b64fb6e49f3076ee14040dcf |
|
MD5 | 7d9b78501c0a88a512f12bba65f4c46b |
|
BLAKE2b-256 | 678e590ba84f22aeb4aae784b2037a66fd5232a695f2e3200eadd8ac2c404c8a |
File details
Details for the file hf_transfer-0.1.4-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: PyPy, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 27d0bc1f8b79a6d65751efbce7eb02d2c1bd7e4de1a46aac18995461590ce4dd |
|
MD5 | dbf19d9ab0ff7d2f1395e6e7c43c1402 |
|
BLAKE2b-256 | 1fc2dbef30439447bc19dad3ded4eb92593c8f831aeaf9a1b8f4237b5d8b048b |
File details
Details for the file hf_transfer-0.1.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: PyPy, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba0647b84d7ff0eee1de6479179a5d43d0695001733f17eecc00153f0f8ab1ac |
|
MD5 | c286de137090bea06a0361c1bd7420f9 |
|
BLAKE2b-256 | 5487853fb5762b5fc732ca3560a81d04b238f2d5527f4e060d4534e3d5bd4d6e |
File details
Details for the file hf_transfer-0.1.4-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: PyPy, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb34a023276936d4716112e17daea4ff98afc35b6113dd0f0383710dc208c058 |
|
MD5 | 56b5dc8533196ce89a78a2e030f2f067 |
|
BLAKE2b-256 | fa56d61442999de77c6e5fc8df7d2b1bc5ee7a0b26512935ad220314099309e9 |
File details
Details for the file hf_transfer-0.1.4-cp312-none-win_amd64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp312-none-win_amd64.whl
- Upload date:
- Size: 1.3 MB
- Tags: CPython 3.12, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6b8518b9ebb85b0238745be81f7b88383c7ea216dd8407d46444bcc7806dc0ef |
|
MD5 | 88d1876fe6b33661943bad9b83684e7e |
|
BLAKE2b-256 | 08aa0b71cb22b66c97b646f6261a02c7bfb008c03aa5beb0b658417c0e2bdbc0 |
File details
Details for the file hf_transfer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: CPython 3.12, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9b9cf169c3c64883b07f7ded5e3f14ae1d437eb77448738b88c923fc5597c47 |
|
MD5 | 6a5c8f544ce15a8e0e661da259a8661f |
|
BLAKE2b-256 | c95201b3d22e20e70d29cd5a021a55506dd211b20f30d581808b453716d9b11d |
File details
Details for the file hf_transfer-0.1.4-cp312-cp312-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp312-cp312-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
- Upload date:
- Size: 3.2 MB
- Tags: CPython 3.12, macOS 10.9+ universal2 (ARM64, x86-64), macOS 10.9+ x86-64, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d07c0d26b5c01ad50d22ddcff7d30c4e8cbb823565b7f61e0ddb35f7faeae415 |
|
MD5 | f3d777f016f44b751fc821d86dd3dad0 |
|
BLAKE2b-256 | a5a44901c230d555304657840392aff2c7072796546ee842e891efc1a737461a |
File details
Details for the file hf_transfer-0.1.4-cp311-none-win_amd64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp311-none-win_amd64.whl
- Upload date:
- Size: 1.3 MB
- Tags: CPython 3.11, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | eca1fe6ae145e88455d0a174248080498cea52ad45cee50702070b47dffa421f |
|
MD5 | a331ca8bd446701b9d3ab362df7a5802 |
|
BLAKE2b-256 | 88b0e49957e3abdae8145219b7cba81408a55b6751c4e8a8798ab36e37802781 |
File details
Details for the file hf_transfer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: CPython 3.11, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 63c9c7aef90facf45391c86131ed00e74333637735cfec52da4f5170004d0b3f |
|
MD5 | 1e52740282ceade020daa62ff48ff664 |
|
BLAKE2b-256 | 7bf2d08d8b2f694e13ab5f76189a71fa633b97931536242ad04e3330125f8e99 |
File details
Details for the file hf_transfer-0.1.4-cp311-cp311-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp311-cp311-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
- Upload date:
- Size: 3.2 MB
- Tags: CPython 3.11, macOS 10.9+ universal2 (ARM64, x86-64), macOS 10.9+ x86-64, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | dab1cf4e2e6fcb963fe0e48e6b5e3a95cf65ee376c7b6618a05dbb2ef0dde183 |
|
MD5 | f1c3113551c18ac34619a4112d7a737d |
|
BLAKE2b-256 | 5f9379157cc253e0be42fc6ff1bc9a648679a4e43f7ac2c57b63c7a3f76f3351 |
File details
Details for the file hf_transfer-0.1.4-cp310-none-win_amd64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp310-none-win_amd64.whl
- Upload date:
- Size: 1.3 MB
- Tags: CPython 3.10, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84c3ce20c68863a7d998711b98726ba9ae8f2e3fc0d685bc2c9ac9833c0f4048 |
|
MD5 | 236b8a4177bb1036ecf8fe0ec646c56b |
|
BLAKE2b-256 | 6c8a0de4c84e7ef683486ee92e04218dae32262feca9246de9d324307171ad57 |
File details
Details for the file hf_transfer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: CPython 3.10, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d1c5c20f76e7f3451cff476b85c55dcb8566ebc94a596cb9eb39c0bb75db8675 |
|
MD5 | d07ac579f9307def249e4d040d502da5 |
|
BLAKE2b-256 | 17415fa31aef6167881ff50b3a4bafb9f4320f6a426a5f6d6c2b9f07c475aac0 |
File details
Details for the file hf_transfer-0.1.4-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
- Upload date:
- Size: 3.2 MB
- Tags: CPython 3.10, macOS 10.9+ universal2 (ARM64, x86-64), macOS 10.9+ x86-64, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ff5fbde30a5bed35ef8f0d4ba78bde9f6d60a233dbff78a0e4035d6e6f71e4c |
|
MD5 | 162ebedef55e3f6469d3f2db99a2c329 |
|
BLAKE2b-256 | 157ceea2d2f2877d55ae0e4e9941d18dbeac57a7d8e18528394a05a285c07fc4 |
File details
Details for the file hf_transfer-0.1.4-cp39-none-win_amd64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp39-none-win_amd64.whl
- Upload date:
- Size: 1.3 MB
- Tags: CPython 3.9, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | dc9c7c1d0d79fc06baf86d41620623bb6bb2736755329ea6b1ec5faf71e3e36b |
|
MD5 | da3173f1865ebfcbaddf9ecdeca1fd49 |
|
BLAKE2b-256 | 4dcce788ffbff830d522bae3b56f603c2a1c181e3021b3c8577129550ad2ef8f |
File details
Details for the file hf_transfer-0.1.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: CPython 3.9, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f3028a807363e0b2c64985c44732ba4ab187a569f013367d2115a6e09ae95031 |
|
MD5 | 5733519fd7c2d7c11a6d8ccd32583569 |
|
BLAKE2b-256 | c787b40fff957d6a5d0c4aeca0462a76ee210b1749cfb4b5c9dafde9ea56ffe7 |
File details
Details for the file hf_transfer-0.1.4-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
- Upload date:
- Size: 3.2 MB
- Tags: CPython 3.9, macOS 10.9+ universal2 (ARM64, x86-64), macOS 10.9+ x86-64, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c04a93acb58e50b8da1e2258185e54f6bf48ba24bf95e470310178b7047c1017 |
|
MD5 | 601260b4ba21ffc06a5ef1930445362c |
|
BLAKE2b-256 | ca485dceebce23c56431582705542a7f8d2e56cb2a18ab1016dcecf17c91fbe8 |
File details
Details for the file hf_transfer-0.1.4-cp38-none-win_amd64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp38-none-win_amd64.whl
- Upload date:
- Size: 1.3 MB
- Tags: CPython 3.8, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ca2d2c40e5e94c5de7e502037ad23ac1d803a2a12760b15b3e3f88c616202bd |
|
MD5 | bbd92b63093f6367b2815576bac4f265 |
|
BLAKE2b-256 | 52d36b712801def8497bcb946e92292b50a8420cd9fbc00ac655c8903b8aae3c |
File details
Details for the file hf_transfer-0.1.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: CPython 3.8, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6d1977e94e8c8fc8a0e9ce74a651d4694629e526da246a492855fcfb710aa489 |
|
MD5 | 2670c40f741ca077c1aaee64e8a33fee |
|
BLAKE2b-256 | 981144b94296ce08c4e165cd76033434487b341beeff04cfe7918e0fc10c6096 |
File details
Details for the file hf_transfer-0.1.4-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
- Upload date:
- Size: 3.2 MB
- Tags: CPython 3.8, macOS 10.9+ universal2 (ARM64, x86-64), macOS 10.9+ x86-64, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 38bce7a511952e1b804168e956cd3a3b1ff7e38828259c3cdae27614060b90c5 |
|
MD5 | 36c2a8a11c02062fa9991e6a7004dad0 |
|
BLAKE2b-256 | a8fae520d9e454b2e2da2be8a143f96466cf387f339876dbfac78e1778020ca4 |
File details
Details for the file hf_transfer-0.1.4-cp37-none-win_amd64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp37-none-win_amd64.whl
- Upload date:
- Size: 1.3 MB
- Tags: CPython 3.7, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 97555bbff69a0459712e5d25d659c0dc74cb8f9726562ca66241f1e1b081f6a9 |
|
MD5 | cc5c1a2c2095d9b0feeab729db620ed3 |
|
BLAKE2b-256 | c42566c318b49c32226b9510bad62111cf1b4d70b647de37266843bfb8735ef9 |
File details
Details for the file hf_transfer-0.1.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 3.9 MB
- Tags: CPython 3.7m, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e81a10dbf2ac534083da06c200456b5d10ba7a1e8c4c5c48f7ea1ca4cf6af474 |
|
MD5 | ca6a604799fa9c5d02f492720eac9e21 |
|
BLAKE2b-256 | 70687436e553d03824e18260d8285cc1d0b0e7649be7d7fd6ed99f5022525983 |
File details
Details for the file hf_transfer-0.1.4-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
.
File metadata
- Download URL: hf_transfer-0.1.4-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
- Upload date:
- Size: 3.2 MB
- Tags: CPython 3.7m, macOS 10.9+ universal2 (ARM64, x86-64), macOS 10.9+ x86-64, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.3.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea32e9f91de3f2dad3567577c293f2e81a9309e680def4712ec0c4ea49be6833 |
|
MD5 | 5dbddd5e94e453c9fdbeab81e2f88fc3 |
|
BLAKE2b-256 | c395e77961ab9c31b1cf9477309dde44895bb7ffdd878c3e4573bb3531551a9f |