Set of tools for web scraping projects
Project description
Weblib
Weblib provides tools to solve typical tasks in web scraping:
processing HTML
handling text encodings
controling repeating and parallel tasks
parsing RSS/ATOM feeds
preparing data for HTTP requests
working with DOM tree
working with text and numeral data
list of common user agents
cross-platform file locking
operations with files and directories
Installation
Run:
pip install -U weblibDocumentation
Docs are incomplete. Most docs are auto-generated from modules/methods docstrings. Check out docs here http://weblib.readthedocs.org/en/latest/
Dependencies
lxml
pytils
six
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
weblib-0.1.16.tar.gz
(38.8 kB
view details)
File details
Details for the file weblib-0.1.16.tar.gz.
File metadata
- Download URL: weblib-0.1.16.tar.gz
- Upload date:
- Size: 38.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 28f5308403feb4ee0c6fc26858938a56a7a3e30dee7059e602a0a8ac552fd892 |
|
| MD5 | 5820d04453d77b1e5b84dc760b32ba15 |
|
| BLAKE2b-256 | 40efe6cf2b2a1d3278f03062688f89e78eec703c8fa53695b571337245d8b971 |
