Extension for dealing with valid and invalid UTF-8 strings
Project description
pyutf8 provides tools to efficiently deal with the validation and cleanup of UTF-8 strings. The primary use case is “garbage in utf-8 out”.
Usage:
>>> from pyutf8 import valid_utf8_bytes >>> SNOWMAN = u'\N{SNOWMAN}' >>> SNOWMAN_BYTES = SNOWMAN.encode('utf-8') >>> valid_utf8_bytes(SNOWMAN) == SNOWMAN_BYTES True >>> valid_utf8_bytes(SNOWMAN_BYTES) == SNOWMAN_BYTES True >>> valid_utf8_bytes('\xff' + SNOWMAN_BYTES + '\xff') == SNOWMAN_BYTES True
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyutf8-0.1.1.tar.gz
(9.6 kB
view hashes)