Set of tools for web scraping projects
Project description
Weblib
Weblib provides tools to solve typical tasks in web scraping:
processing HTML
handling text encodings
controling repeating and parallel tasks
parsing RSS/ATOM feeds
preparing data for HTTP requests
working with DOM tree
working with text and numeral data
list of common user agents
cross-platform file locking
operations with files and directories
Installation
Run:
pip install -U weblibDocumentation
Docs are incomplete. Most docs are auto-generated from modules/methods docstrings. Check out docs here http://weblib.readthedocs.org/en/latest/
Dependencies
lxml
pytils
six
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
weblib-0.1.19.tar.gz
(39.5 kB
view details)
File details
Details for the file weblib-0.1.19.tar.gz.
File metadata
- Download URL: weblib-0.1.19.tar.gz
- Upload date:
- Size: 39.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 6666a3602c61e21e32436c0c2f62c965c7fc675a414a1e3b7b5da438924bc2a3 |
|
| MD5 | 9fb80630fd6e2029f73006e020e74455 |
|
| BLAKE2b-256 | e422651953c65053e151637d4d83220fea283747abcd3a9d1fcfad46cb41ed0a |
