Python HTML/XML parser for easy web scraping.
Project description
What is it?
DHTMLParser3 is a lightweight HTML/XML parser created for one purpose - quick and easy picking selected tags from DOM.
It can be very useful when you are in need to write own “guerilla” API for some webpage, or a scrapper.
It is written in pure python with no dependencies, and it can handle pretty badly broken HTML.
Documentation
Full module documentation can be found here: http://DHTMLParser3.rtfd.org
Changelog
3.0.10
Implemented proper .__copy__() and .__deepcopy__() methods.
3.0.9
Fixed the way how the quotes are escaped in the tag parameters.
3.0.8
Fixed behavior of the .__hash__() method for nested tags.
3.0.7
Don’t escape <script> and <style> content’s.
3.0.6
Fixed behavior of .match() method.
Added new method .match_paths().
Added tests.
3.0.5
Bugfix; SpecialDict.copy() didn’t return any value.
3.0.4
Bugfix; Don’t search empty tags.
3.0.3
Bugfix; Always return container element for small doms with only strings inside.
3.0.2
Added .__hash__() method for Tag.
.replace_with() method now accepts str as well as Tag.
Fixed problems with .parent setting for non-pair tags in the parser.
Added bunch of tests to test newly added stuff.
3.0.1
Added .__contains__() method for Tag, so you can now test parameters using in operator.
3.0.0
Rewritten to use different parser, support for HTML entities.
Structure of the classes completely changed, now Tag & Comment are used instead of HTMLElement.
Much more cleaner code and more comprehensive method names.
By default, the tree is now double-linked without any additional cost.
Implemented very useful magic methods, so indexing operators are supported for access to both parameters and content.
Documentation completely reworked.
Set of coverage tests is now much larger.
2.2.3
2020-04-12 Fix by #25 (thx https://github.com/fm4d).
2.2.2
Attempt to fix strange recursive inheritance problem.
2.2.0
Rewritten for compatibility with python3.
2.1.0 - 2.1.8
State parser fixed - it can now recover from invalid html like <invalid tag=something">.
Rewritten to use StateEnum in parser for better readability.
Garbage collector is now disabled during _raw_split().
Fixed #16 - recovery after tags which don’t ends with > (</code for example).
Closed #17 - implementation of ignoring of < in usage as is smaller than sign.
Restored support of multiline attributes.
.parseString() now doesn’t try to parse HTML element parameters.
Implemented first() getter.
License changed to MIT.
Fixed #18: bug which in some cases caused invalid output.
Added HTMLElement.__repr__().
Added test_coverage.sh.
Added extended test_equality() coverage.
Formatting improvements.
Improved constructor handling, which is now much more readable.
Updated formatting of the setup.py.
Added more tests.
Fixed #22; bug in the SpecialDict.
Fixed some nasty unicode problems.
Fixed python 2 / 3 problem in docs/__init__.py.
getVersion() -> get_version().
2.0.10
Added more tests of removeTags().
run_tests.sh now gets arguments.
Check for string in removeTags() changed to basestring from str.
2.0.6 - 2.0.9
Fixed behaviour of toString() and tagToString().
SpecialDict is now derived from OrderedDict.
Changed and added tests of .params attribute (OrderedDict is now used).
Fixed bug in _repair_tags().
Removed _repair_tags() - it wasn’t really necessary.
Fixed nasty bug which could cause invalid XML output.
2.0.1 - 2.0.5
Fixed bugs in .match().
Fixed broken links in documentation.
Fixed bugs in .isAlmostEqual().
.find(); Fixed bug which prevented tag_name to be None.
Added op .__eq__() to the SpecialDict.
Added new method .containsParamSubset() to HTMLElement.
2.0.0
Rewritten, refactored, splitted to multiple files.
Added unittest coverage of almost 100% of the code.
Added better selector methods (.wfind(), .match)
Added Sphinx documentation.
Fixed a lot of bugs.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file DHTMLParser3-3.0.10-py3-none-any.whl
.
File metadata
- Download URL: DHTMLParser3-3.0.10-py3-none-any.whl
- Upload date:
- Size: 15.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: Python-urllib/3.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 232cbb87a6c71a470fec070ed9692452fe21f311c363f8a39a4d279b2918d40a |
|
MD5 | 0fc89f8df6ac23153c6f0a89519a44ae |
|
BLAKE2b-256 | 5e139152abc3ef5b64120a71fd8b040786c9d5053ddd23ed48bee5e41dd8265c |