Set of tools for web scraping projects
Project description
Weblib
Weblib provides tools to solve typical tasks in web scraping:
processing HTML
handling text encodings
controling repeating and parallel tasks
parsing RSS/ATOM feeds
preparing data for HTTP requests
working with DOM tree
working with text and numeral data
list of common user agents
cross-platform file locking
operations with files and directories
Installation
Run:
pip install -U weblibDocumentation
Docs are incomplete. Most docs are auto-generated from modules/methods docstrings. Check out docs here http://weblib.readthedocs.org/en/latest/
Dependencies
lxml
pytils
six
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
weblib-0.1.20.tar.gz
(37.0 kB
view details)
File details
Details for the file weblib-0.1.20.tar.gz.
File metadata
- Download URL: weblib-0.1.20.tar.gz
- Upload date:
- Size: 37.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d49687b97ecb61cb7ab4df947f1f0b084a3514476fa910a9d3b554876e05bdbb |
|
| MD5 | d08c4a4921f27b8daa3fdfe69e0f1195 |
|
| BLAKE2b-256 | 062a8c79a7d7e28d3fced1cc7ffc091eec3e95adb35582898cd921c47ef495c5 |
