Set of tools for web scraping projects
Project description
Weblib
Weblib provides tools to solve typical tasks in web scraping:
processing HTML
handling text encodings
controling repeating and parallel tasks
parsing RSS/ATOM feeds
preparing data for HTTP requests
working with DOM tree
working with text and numeral data
list of common user agents
cross-platform file locking
operations with files and directories
Installation
Run:
pip install -U weblibDocumentation
Docs are incomplete. Most docs are auto-generated from modules/methods docstrings. Check out docs here http://weblib.readthedocs.org/en/latest/
Dependencies
lxml
pytils
six
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
weblib-0.1.17.tar.gz
(39.0 kB
view details)
File details
Details for the file weblib-0.1.17.tar.gz.
File metadata
- Download URL: weblib-0.1.17.tar.gz
- Upload date:
- Size: 39.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d9f0b8d9c807af97d752bc0183f9b0cf3bdb3dc87cda17f57a163f193c4a3f5e |
|
| MD5 | 1679f77d4618ec6bca4309e54b4532d1 |
|
| BLAKE2b-256 | 8f606a85c39447cbfad292c717cdc19fa2283834d13f9be08cdbddbd9718c1ea |
