Python package to handle download of multiple types of files.
Project description
Python package to handle the download of multiple types of files.
How do I install this package?
As usual, just download it using pip:
pip install downloadersUsage examples
from downloaders import BaseDownloader
downloader = BaseDownloader()
urls = [...]
downloader.download(urls)Tests Coverage
Since some software handling coverages sometimes get slightly different results, here’s three of them:
Troubleshooting
MacOS multiprocessing nightmare fuel
Cupertino has a gift for us: somehow multiprocessing on MacOS in some specific astral configurations that I have yet to fully understand, it will crash with the following error:
The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.Apparently, this can be easily fixed by changing the way multiprocessing spawns processes, that is:
import platform, multiprocessing
if platform.system() == "Darwin":
multiprocessing.set_start_method('spawn')The aforementioned solution was proposed on this StackOverflow question.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file downloaders-1.0.1.tar.gz.
File metadata
- Download URL: downloaders-1.0.1.tar.gz
- Upload date:
- Size: 9.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.24.0 setuptools/45.2.0.post20200210 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 15b23da7897cf1a132fc0214af86047f9ce4c8864d56ab10b642f59416489d57 |
|
| MD5 | 157d19abf6a4ce3e3c3986f38cb745bf |
|
| BLAKE2b-256 | 58dc9dc3fa460eb3b90f442dc20b1df24c745afea8b35d8d7acab6cfb9194f69 |
