Skip to main content

No project description provided

Project description

HF Transfer

Speed up file transfers with the Hub.

DISCLAIMER

This library is a power user tool, to go beyond ~500MB/s on very high bandwidth network, where Python cannot cap out the available bandwidth.

This is not meant to be a general usability tool. It purposefully lacks progressbars and comes generally as-is.

Please file issues only if there's an issue on the underlying downloaded file.

Contributing

python3 -m venv ~/.venv/hf_transfer
source ~/.venv/hf_transfer/bin/activate
pip install maturin
maturin develop

huggingface_hub

If you are working on changes with huggingface_hub

git clone git@github.com:huggingface/huggingface_hub.git
# git clone https://github.com/huggingface/huggingface_hub.git

cd huggingface_hub
python3 -m pip install -e ".[quality]"

You can use the following test script:

import os

# os.environ["HF_ENDPOINT"] = "http://localhost:5564"
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"

from huggingface_hub import HfApi, logging

logging.set_verbosity_debug()
hf = HfApi()
hf.upload_file(path_or_fileobj="/path/to/my/repo/some_file", path_in_repo="some_file", repo_id="my/repo", repo_type="model")

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hf_transfer-0.1.4.tar.gz (20.6 kB view details)

Uploaded Source

Built Distributions

hf_transfer-0.1.4-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-cp312-none-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.12 Windows x86-64

hf_transfer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-cp312-cp312-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (3.2 MB view details)

Uploaded CPython 3.12 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

hf_transfer-0.1.4-cp311-none-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.11 Windows x86-64

hf_transfer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-cp311-cp311-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (3.2 MB view details)

Uploaded CPython 3.11 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

hf_transfer-0.1.4-cp310-none-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.10 Windows x86-64

hf_transfer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (3.2 MB view details)

Uploaded CPython 3.10 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

hf_transfer-0.1.4-cp39-none-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.9 Windows x86-64

hf_transfer-0.1.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (3.2 MB view details)

Uploaded CPython 3.9 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

hf_transfer-0.1.4-cp38-none-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.8 Windows x86-64

hf_transfer-0.1.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (3.2 MB view details)

Uploaded CPython 3.8 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

hf_transfer-0.1.4-cp37-none-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.7 Windows x86-64

hf_transfer-0.1.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.4-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (3.2 MB view details)

Uploaded CPython 3.7m macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

File details

Details for the file hf_transfer-0.1.4.tar.gz.

File metadata

  • Download URL: hf_transfer-0.1.4.tar.gz
  • Upload date:
  • Size: 20.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/1.3.1

File hashes

Hashes for hf_transfer-0.1.4.tar.gz
Algorithm Hash digest
SHA256 687e090639cd52a48dedbfaa9e455a2c99c5169ece3d911f95983b1d4d4c84ed
MD5 1f0ba5f65938a7ea5de1c1c962a522d2
BLAKE2b-256 5dc26736069e3e42c14259bf263b682ddcff8ef0e1a3c5c5af4dc2b907d66759

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 1a466ae2b11d72df9e0005eb8ff7f537d5460c98b64fb6e49f3076ee14040dcf
MD5 7d9b78501c0a88a512f12bba65f4c46b
BLAKE2b-256 678e590ba84f22aeb4aae784b2037a66fd5232a695f2e3200eadd8ac2c404c8a

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 27d0bc1f8b79a6d65751efbce7eb02d2c1bd7e4de1a46aac18995461590ce4dd
MD5 dbf19d9ab0ff7d2f1395e6e7c43c1402
BLAKE2b-256 1fc2dbef30439447bc19dad3ded4eb92593c8f831aeaf9a1b8f4237b5d8b048b

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ba0647b84d7ff0eee1de6479179a5d43d0695001733f17eecc00153f0f8ab1ac
MD5 c286de137090bea06a0361c1bd7420f9
BLAKE2b-256 5487853fb5762b5fc732ca3560a81d04b238f2d5527f4e060d4534e3d5bd4d6e

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 fb34a023276936d4716112e17daea4ff98afc35b6113dd0f0383710dc208c058
MD5 56b5dc8533196ce89a78a2e030f2f067
BLAKE2b-256 fa56d61442999de77c6e5fc8df7d2b1bc5ee7a0b26512935ad220314099309e9

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp312-none-win_amd64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp312-none-win_amd64.whl
Algorithm Hash digest
SHA256 6b8518b9ebb85b0238745be81f7b88383c7ea216dd8407d46444bcc7806dc0ef
MD5 88d1876fe6b33661943bad9b83684e7e
BLAKE2b-256 08aa0b71cb22b66c97b646f6261a02c7bfb008c03aa5beb0b658417c0e2bdbc0

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a9b9cf169c3c64883b07f7ded5e3f14ae1d437eb77448738b88c923fc5597c47
MD5 6a5c8f544ce15a8e0e661da259a8661f
BLAKE2b-256 c95201b3d22e20e70d29cd5a021a55506dd211b20f30d581808b453716d9b11d

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp312-cp312-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp312-cp312-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 d07c0d26b5c01ad50d22ddcff7d30c4e8cbb823565b7f61e0ddb35f7faeae415
MD5 f3d777f016f44b751fc821d86dd3dad0
BLAKE2b-256 a5a44901c230d555304657840392aff2c7072796546ee842e891efc1a737461a

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp311-none-win_amd64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp311-none-win_amd64.whl
Algorithm Hash digest
SHA256 eca1fe6ae145e88455d0a174248080498cea52ad45cee50702070b47dffa421f
MD5 a331ca8bd446701b9d3ab362df7a5802
BLAKE2b-256 88b0e49957e3abdae8145219b7cba81408a55b6751c4e8a8798ab36e37802781

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 63c9c7aef90facf45391c86131ed00e74333637735cfec52da4f5170004d0b3f
MD5 1e52740282ceade020daa62ff48ff664
BLAKE2b-256 7bf2d08d8b2f694e13ab5f76189a71fa633b97931536242ad04e3330125f8e99

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp311-cp311-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp311-cp311-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 dab1cf4e2e6fcb963fe0e48e6b5e3a95cf65ee376c7b6618a05dbb2ef0dde183
MD5 f1c3113551c18ac34619a4112d7a737d
BLAKE2b-256 5f9379157cc253e0be42fc6ff1bc9a648679a4e43f7ac2c57b63c7a3f76f3351

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp310-none-win_amd64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp310-none-win_amd64.whl
Algorithm Hash digest
SHA256 84c3ce20c68863a7d998711b98726ba9ae8f2e3fc0d685bc2c9ac9833c0f4048
MD5 236b8a4177bb1036ecf8fe0ec646c56b
BLAKE2b-256 6c8a0de4c84e7ef683486ee92e04218dae32262feca9246de9d324307171ad57

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d1c5c20f76e7f3451cff476b85c55dcb8566ebc94a596cb9eb39c0bb75db8675
MD5 d07ac579f9307def249e4d040d502da5
BLAKE2b-256 17415fa31aef6167881ff50b3a4bafb9f4320f6a426a5f6d6c2b9f07c475aac0

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 6ff5fbde30a5bed35ef8f0d4ba78bde9f6d60a233dbff78a0e4035d6e6f71e4c
MD5 162ebedef55e3f6469d3f2db99a2c329
BLAKE2b-256 157ceea2d2f2877d55ae0e4e9941d18dbeac57a7d8e18528394a05a285c07fc4

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp39-none-win_amd64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp39-none-win_amd64.whl
Algorithm Hash digest
SHA256 dc9c7c1d0d79fc06baf86d41620623bb6bb2736755329ea6b1ec5faf71e3e36b
MD5 da3173f1865ebfcbaddf9ecdeca1fd49
BLAKE2b-256 4dcce788ffbff830d522bae3b56f603c2a1c181e3021b3c8577129550ad2ef8f

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 f3028a807363e0b2c64985c44732ba4ab187a569f013367d2115a6e09ae95031
MD5 5733519fd7c2d7c11a6d8ccd32583569
BLAKE2b-256 c787b40fff957d6a5d0c4aeca0462a76ee210b1749cfb4b5c9dafde9ea56ffe7

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 c04a93acb58e50b8da1e2258185e54f6bf48ba24bf95e470310178b7047c1017
MD5 601260b4ba21ffc06a5ef1930445362c
BLAKE2b-256 ca485dceebce23c56431582705542a7f8d2e56cb2a18ab1016dcecf17c91fbe8

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp38-none-win_amd64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp38-none-win_amd64.whl
Algorithm Hash digest
SHA256 6ca2d2c40e5e94c5de7e502037ad23ac1d803a2a12760b15b3e3f88c616202bd
MD5 bbd92b63093f6367b2815576bac4f265
BLAKE2b-256 52d36b712801def8497bcb946e92292b50a8420cd9fbc00ac655c8903b8aae3c

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 6d1977e94e8c8fc8a0e9ce74a651d4694629e526da246a492855fcfb710aa489
MD5 2670c40f741ca077c1aaee64e8a33fee
BLAKE2b-256 981144b94296ce08c4e165cd76033434487b341beeff04cfe7918e0fc10c6096

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 38bce7a511952e1b804168e956cd3a3b1ff7e38828259c3cdae27614060b90c5
MD5 36c2a8a11c02062fa9991e6a7004dad0
BLAKE2b-256 a8fae520d9e454b2e2da2be8a143f96466cf387f339876dbfac78e1778020ca4

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp37-none-win_amd64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp37-none-win_amd64.whl
Algorithm Hash digest
SHA256 97555bbff69a0459712e5d25d659c0dc74cb8f9726562ca66241f1e1b081f6a9
MD5 cc5c1a2c2095d9b0feeab729db620ed3
BLAKE2b-256 c42566c318b49c32226b9510bad62111cf1b4d70b647de37266843bfb8735ef9

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e81a10dbf2ac534083da06c200456b5d10ba7a1e8c4c5c48f7ea1ca4cf6af474
MD5 ca6a604799fa9c5d02f492720eac9e21
BLAKE2b-256 70687436e553d03824e18260d8285cc1d0b0e7649be7d7fd6ed99f5022525983

See more details on using hashes here.

File details

Details for the file hf_transfer-0.1.4-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for hf_transfer-0.1.4-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 ea32e9f91de3f2dad3567577c293f2e81a9309e680def4712ec0c4ea49be6833
MD5 5dbddd5e94e453c9fdbeab81e2f88fc3
BLAKE2b-256 c395e77961ab9c31b1cf9477309dde44895bb7ffdd878c3e4573bb3531551a9f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page