html-text 0.3.0

Install

Install with pip:

pip install html-text

The package depends on lxml, so you might need to install some additional packages: http://lxml.de/installation.html

Usage

Extract text from HTML:

>>> import html_text
>>> text = html_text.extract_text(u'<h1>Hey</h1>')
u'Hey'

You can also pass already parsed lxml.html.HtmlElement:

>>> import html_text
>>> tree = html_text.parse_html(u'<h1>Hey</h1>')
>>> text = html_text.extract_text(tree)
u'Hey'

Passed html will be first cleaned from invisible non-text content such as styles, and then text would be extracted. Two functions that do it are html_text.cleaned_selector and html_text.selector_to_text:

• html_text.cleaned_selector accepts html as text or as lxml.html.HtmlElement, and returns cleaned parsel.Selector.

• html_text.selector_to_text accepts parsel.Selector and returns extracted text.

Credits

The code is extracted from utilities used in several projects, written by Mikhail Korobov.

0.3.0 (2017-10-12)

• Expose functions that operate on selectors, use .//text() to extract text from selector.

0.2.1 (2017-05-29)

• Packaging fix (include CHANGES.rst)

0.2.0 (2017-05-29)

• Fix unwanted joins of words with inline tags: spaces are added for inline tags too, but a heuristic is used to preserve punctuation without extra spaces.

• Accept parsed html trees.

0.1.1 (2017-01-16)

• Travis-CI and codecov.io integrations added

0.1.0 (2016-09-27)

• First release on PyPI.