A general-purpose computer algebra system.
Project description
Mathics Scanner
This is the tokeniser or scanner portion for the Wolfram Language.
As such, it also contains a full set of translation between Wolfram Language named characters, their Unicode/ASCII equivalents and code-points.
Uses
This is used as the scanner inside Mathics but it can also be used for tokenizing and formatting Wolfram Language code. In fact we intend to write one. This library is also quite usefull if you need to work with Wolfram Language named character and convert them to various formats.
Usage
For tokenizing and scanning Wolfram Language code, use the mathics_scanner.tokenizer.Tokenizer class.
To convert between Wolfram Language named characters and Unicode/ASCII, use the mathics_scanner.characters.replace_wl_with_plain_text and mathics_scanner.characters.replace_unicode_with_wl functions.
To convert between qualified names of named characters (such FormalA for \[FormalA]) and Wolfram’s internal representation use the m̀athics_scanner.characters.named_characters dictionary.
To regenerate scanner tables run:
$ mathics-generate-json-table
Implementation
For notes on the implementation of the packages or details on the conversion scheme please read implementation.rst.
Contributing
Please feel encouraged to contribute to this package or Mathics! Create your own fork, make the desired changes, commit, and make a pull request.
License
Mathics is released under the GNU General Public License Version 3 (GPL3).
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
File details
Details for the file Mathics_Scanner-1.2.0.tar.gz.
File metadata
- Download URL: Mathics_Scanner-1.2.0.tar.gz
- Upload date:
- Size: 81.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b40c2144adb12654df600e4464cf8db6584572854476198c0d1fec3cf887f283 |
|
| MD5 | 611ff95ec4f4a9fa999ddb895c064419 |
|
| BLAKE2b-256 | b2b039f8863b6e0f520411e1ca4a2e4716964a7e3a8082deb7b1e5d8ccc2f45b |
Provenance
File details
Details for the file Mathics_Scanner-1.2.0-py3.9.egg.
File metadata
- Download URL: Mathics_Scanner-1.2.0-py3.9.egg
- Upload date:
- Size: 75.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3ac3845c5fd9af14475493e09bed1187e6406fe4e076c698bfb2a555e03d1cc4 |
|
| MD5 | 17a5ac325e187880a48fa23dda31501b |
|
| BLAKE2b-256 | 1d36a951433071c38f44235aaa7754d8f0723161accd2ae17da52437a57998c7 |
Provenance
File details
Details for the file Mathics_Scanner-1.2.0-py3.8.egg.
File metadata
- Download URL: Mathics_Scanner-1.2.0-py3.8.egg
- Upload date:
- Size: 75.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1ebe93aa83ee5bd7b9a13b5a164ce322a6a95b2f92f19db9a6b4afb31e4ed04f |
|
| MD5 | 1419deb6471807afe6af7a393857b030 |
|
| BLAKE2b-256 | 284f1df213190a4af5449553458d2856554813e5d234cd5b5821480b642a19e5 |
Provenance
File details
Details for the file Mathics_Scanner-1.2.0-py3.7.egg.
File metadata
- Download URL: Mathics_Scanner-1.2.0-py3.7.egg
- Upload date:
- Size: 75.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7bb4ecba581c12f5f953ac6e0ce136ae79f93c780d3630cc69d6390c98910ed7 |
|
| MD5 | aecb39c0399bebf39977c784a4f480b6 |
|
| BLAKE2b-256 | cdb3a885e6a0b0b6878d15f342dfa2706cef23456173147d17339d0bf6c7bd79 |
Provenance
File details
Details for the file Mathics_Scanner-1.2.0-py3.6.egg.
File metadata
- Download URL: Mathics_Scanner-1.2.0-py3.6.egg
- Upload date:
- Size: 75.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7ce21ab7ef26a45f84bceb6dd30907942706dbd65b148bb7b9d85fc17a5016a8 |
|
| MD5 | 44e1793b1837fbcd8af34e699eca0fe0 |
|
| BLAKE2b-256 | 1c1e88c3e5eb087ba4be6ea1472404004403167e0e011148c3d98cfc3830d8ca |
Provenance
File details
Details for the file Mathics_Scanner-1.2.0-py3-none-any.whl.
File metadata
- Download URL: Mathics_Scanner-1.2.0-py3-none-any.whl
- Upload date:
- Size: 58.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f4c09a62d4ca536462e652e3fc9cd8101df74fea1a51380d73474371bdc62363 |
|
| MD5 | 91890e0460f4fe39838c7ca092c0a7fb |
|
| BLAKE2b-256 | 0f4ce963e26456f526e4d9e47621ce0b99db2a5c3a0569e7b3652798391a0499 |
Provenance
File details
Details for the file Mathics_Scanner-1.2.0-py2.py3-none-any.whl.
File metadata
- Download URL: Mathics_Scanner-1.2.0-py2.py3-none-any.whl
- Upload date:
- Size: 58.4 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9e37889b8e076daf13e9d7f1a09a08abb33b191c6ff6f90969b3ecb1e699cdb7 |
|
| MD5 | 9233c33907893b3a6b1326236ceeb806 |
|
| BLAKE2b-256 | ff674da65399a553f22f826b75a444c63c91d5df7190398a4ba19b21beb46e8f |
