Set of tools for web scraping projects
Project description
Weblib
Weblib provides tools to solve typical tasks in web scraping:
processing HTML
handling text encodings
controling repeating and parallel tasks
parsing RSS/ATOM feeds
preparing data for HTTP requests
working with DOM tree
working with text and numeral data
list of common user agents
cross-platform file locking
operations with files and directories
Installation
Run:
pip install -U weblibDocumentation
Docs are incomplete. Most docs are auto-generated from modules/methods docstrings. Check out docs here http://weblib.readthedocs.org/en/latest/
Dependencies
lxml
pytils
six
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
weblib-0.1.18.tar.gz
(39.5 kB
view details)
File details
Details for the file weblib-0.1.18.tar.gz.
File metadata
- Download URL: weblib-0.1.18.tar.gz
- Upload date:
- Size: 39.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a3482368621889fec331e27da8e2b6f5111cfdc35e2a5adacc53eee6c281c86a |
|
| MD5 | 386b289cc11431c2a93f3ba026deb305 |
|
| BLAKE2b-256 | 8e49a26e57d8677ee6ce68a55d636903fff1a7ff664bfae48b134ce0afa55d37 |
