Python package to handle download of multiple types of files.
Project description
Downloaders
Python package to handle the download of multiple types of files.
How do I install this package?
As usual, just download it using pip:
pip install downloaders
Usage examples
from downloaders import BaseDownloader
downloader = BaseDownloader()
urls = [...]
downloader.download(urls)
Troubleshooting
MacOS multiprocessing nightmare fuel
Cupertino has a gift for us: somehow, under certain specific astral configurations on MacOS (which I have yet to fully understand), multiprocessing will crash with the following error:
The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.
Apparently, this can be easily fixed by changing the way multiprocessing spawns processes:
import platform, multiprocessing
if platform.system() == "Darwin":
multiprocessing.set_start_method('spawn')
The aforementioned solution was proposed on this StackOverflow question.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
downloaders-1.0.22.tar.gz
(11.7 kB
view details)
File details
Details for the file downloaders-1.0.22.tar.gz.
File metadata
- Download URL: downloaders-1.0.22.tar.gz
- Upload date:
- Size: 11.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.63.1 importlib-metadata/4.11.3 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.7.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5bc676d0221a009fcad18257e058dbf50d04aa2337e57b215d25de36c14e6ec3 |
|
| MD5 | bd95028ced0dd251404fd85893ab6702 |
|
| BLAKE2b-256 | d6bc49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55 |
