No project description provided

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Project description



Build GitHub


Tokenizers

Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Bindings over the Rust implementation. If you are interested in the High-level design, you can go check it there.

Otherwise, let's dive in!

Main features:

  • Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3 most common BPE versions).
  • Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes less than 20 seconds to tokenize a GB of text on a server's CPU.
  • Easy to use, but also extremely versatile.
  • Designed for research and production.
  • Normalization comes with alignments tracking. It's always possible to get the part of the original sentence that corresponds to a given token.
  • Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.

Installation

With pip:

pip install tokenizers

From sources:

To use this method, you need to have the Rust installed:

# Install with:
curl https://sh.rustup.rs -sSf | sh -s -- -y
export PATH="$HOME/.cargo/bin:$PATH"

Once Rust is installed, you can compile doing the following

git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python

# Create a virtual env (you can use yours as well)
python -m venv .env
source .env/bin/activate

# Install `tokenizers` in the current virtual env
pip install -e .

Load a pretrained tokenizer from the Hub

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_pretrained("bert-base-cased")

Using the provided Tokenizers

We provide some pre-build tokenizers to cover the most common cases. You can easily load one of these using some vocab.json and merges.txt files:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
vocab = "./path/to/vocab.json"
merges = "./path/to/merges.txt"
tokenizer = CharBPETokenizer(vocab, merges)

# And then encode:
encoded = tokenizer.encode("I can feel the magic, can you?")
print(encoded.ids)
print(encoded.tokens)

And you can train them just as simply:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
tokenizer = CharBPETokenizer()

# Then train it!
tokenizer.train([ "./path/to/files/1.txt", "./path/to/files/2.txt" ])

# Now, let's use it:
encoded = tokenizer.encode("I can feel the magic, can you?")

# And finally save it somewhere
tokenizer.save("./path/to/directory/my-bpe.tokenizer.json")

Provided Tokenizers

  • CharBPETokenizer: The original BPE
  • ByteLevelBPETokenizer: The byte level version of the BPE
  • SentencePieceBPETokenizer: A BPE implementation compatible with the one used by SentencePiece
  • BertWordPieceTokenizer: The famous Bert tokenizer, using WordPiece

All of these can be used and trained as explained above!

Build your own

Whenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer, by putting all the different parts you need together. You can check how we implemented the provided tokenizers and adapt them easily to your own needs.

Building a byte-level BPE

Here is an example showing how to build your own byte-level BPE by putting all the different pieces together, and then saving it to a single file:

from tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors

# Initialize a tokenizer
tokenizer = Tokenizer(models.BPE())

# Customize pre-tokenization and decoding
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.ByteLevel(trim_offsets=True)

# And then train
trainer = trainers.BpeTrainer(
    vocab_size=20000,
    min_frequency=2,
    initial_alphabet=pre_tokenizers.ByteLevel.alphabet()
)
tokenizer.train([
    "./path/to/dataset/1.txt",
    "./path/to/dataset/2.txt",
    "./path/to/dataset/3.txt"
], trainer=trainer)

# And Save it
tokenizer.save("byte-level-bpe.tokenizer.json", pretty=True)

Now, when you want to use this tokenizer, this is as simple as:

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_file("byte-level-bpe.tokenizer.json")

encoded = tokenizer.encode("I can feel the magic, can you?")

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Release history Release notifications | RSS feed

0.20.3

0.20.3rc0 pre-release

0.20.2

0.20.1

0.20.1rc1 pre-release

0.20.0

0.20.0rc1 pre-release

0.19.1

0.19.0

0.15.2

0.15.2rc1 pre-release

0.15.1

0.15.0

This version

0.14.1

0.14.0

0.13.3

0.13.2

0.13.1

0.13.0

0.12.1

0.12.0 yanked

Reason this release was yanked:

Breaking change with unexpected effect

0.11.6

0.11.5

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.3

0.10.2

0.10.1

0.10.1rc1 pre-release

0.10.0

0.10.0rc1 pre-release

0.9.4

0.9.3

0.9.2

0.9.1

0.9.0

0.9.0rc2 pre-release

0.9.0rc1 pre-release

0.9.0.dev4 pre-release

0.9.0.dev3 pre-release

0.9.0.dev2 pre-release

0.9.0.dev1 pre-release

0.9.0.dev0 pre-release

0.8.1

0.8.1rc2 pre-release

0.8.1rc1 pre-release

0.8.0

0.8.0rc4 pre-release

0.8.0rc3 pre-release

0.8.0rc2 pre-release

0.8.0rc1 pre-release

0.8.0.dev2 pre-release

0.8.0.dev1 pre-release

0.8.0.dev0 pre-release

0.7.0

0.7.0rc7 pre-release

0.7.0rc6 pre-release

0.7.0rc5 pre-release

0.7.0rc4 pre-release

0.7.0rc3 pre-release

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.5.2

0.5.1

0.5.0

0.4.2

0.4.1

0.4.0

0.3.0

0.2.1

0.2.0

0.1.1

0.1.0

0.0.13

0.0.12

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenizers-0.14.1.tar.gz (317.3 kB view details)

Uploaded Source

Built Distributions

tokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ s390x

tokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.12+ i686

tokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

tokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.12 macOS 10.7+ x86-64

tokenizers-0.14.1-cp311-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.11 Windows x86-64

tokenizers-0.14.1-cp311-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.11 Windows x86

tokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ s390x

tokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.12+ i686

tokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

tokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.11 macOS 10.7+ x86-64

tokenizers-0.14.1-cp310-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.10 Windows x86-64

tokenizers-0.14.1-cp310-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.10 Windows x86

tokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ s390x

tokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.12+ i686

tokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10 macOS 10.7+ x86-64

tokenizers-0.14.1-cp39-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.9 Windows x86-64

tokenizers-0.14.1-cp39-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.9 Windows x86

tokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ s390x

tokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.12+ i686

tokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

tokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.9 macOS 10.7+ x86-64

tokenizers-0.14.1-cp38-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.8 Windows x86-64

tokenizers-0.14.1-cp38-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.8 Windows x86

tokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ s390x

tokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.12+ i686

tokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.8 macOS 11.0+ ARM64

tokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.8 macOS 10.7+ x86-64

tokenizers-0.14.1-cp37-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.7 Windows x86-64

tokenizers-0.14.1-cp37-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.7 Windows x86

tokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ x86-64

tokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ ARM64

tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ s390x

tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

tokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ i686

tokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.7m macOS 11.0+ ARM64

tokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.7m macOS 10.7+ x86-64

File details

Details for the file tokenizers-0.14.1.tar.gz.

File metadata

  • Download URL: tokenizers-0.14.1.tar.gz
  • Upload date:
  • Size: 317.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.1.tar.gz
Algorithm Hash digest
SHA256 ea3b3f8908a9a5b9d6fc632b5f012ece7240031c44c6d4764809f33736534166
MD5 84ebdd4df7cfe0b939d711cf1f9b1a0c
BLAKE2b-256 b2b9bf025d763bbdd333cb88bedb23426f932c5b4a6ce6f033c498517fad5b90

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 956729b7dd599020e57133fb95b777e4f81ee069ff0a70e80f6eeac82658972f
MD5 efcd045c19f9d5bec3821363b4c24989
BLAKE2b-256 036271982b18db663f8092703e5f62891f9b34c4627dda47b4f8bc1f8018e9b6

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 67d3adff654dc7f7c7091dd259b3b847fe119c08d0bda61db91e2ea2b61c38c0
MD5 94e7971095d9d15a170f2df9fc1961ac
BLAKE2b-256 288fd1b17d547a33ff2a56c9bd79d8fcf6d1d9194800b0f34c602954e66c05cb

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 4c7cfc3d42e81cda802f93aa9e92caf79feaa1711426e28ce620560b8aaf5e4d
MD5 8369d4629b0ab07411a173a3f73ea8c2
BLAKE2b-256 9821296282e5f0e1c1ddaf2fd20d337437eb43810892c76e1436a2cdbe5f9889

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 0ce2f0ff2e5f12ac5bebaa690606395725239265d7ffa35f35c243a379316297
MD5 a1920c5564271c14921391164cd1a366
BLAKE2b-256 f6dd2d77cce54578f5dbd527df39f91774dec68c4dbd7eeef1b34b84fb3a3e27

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 7975178f9478ccedcf613332d5d6f37b67c74ef4e2e47e0c965597506b921f04
MD5 648d93f1d9edf0665bf41c19a3dca25b
BLAKE2b-256 c1f59311011243702a2dc833b5b3ddd556884748ea82ceb779a4e0e9eebc975f

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6859d81243cd09854be9054aca3ecab14a2dee5b3c9f6d7ef12061d478ca0c57
MD5 4f85fd0822ca1fd52bd151ff7c6286ae
BLAKE2b-256 d2f2a3d2e0a4ba4f33c77b39e0497b653f8ea61abbbb7fb575a96a86aa19b931

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 5f9afdcf701a1aa3c41e0e748c152d2162434d61639a1e5d8523ecf60ae35aea
MD5 fdf22bf124c48a9a0a3b1168ca0fdff7
BLAKE2b-256 2e544e23656820078348f4bc22a353d5ca8a118a37909f787a5a7981ff4d27b6

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 628b654ba555b2ba9111c0936d558b14bfc9d5f57b8c323b02fc846036b38b2f
MD5 3a4a16ec90800a1776a3f003f4eda4de
BLAKE2b-256 5a72f87cad6404a01db736cf2297d1859675471cdf69cc402df693d221501ef2

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 92c34de04fec7f4ff95f7667d4eb085c4e4db46c31ef44c3d35c38df128430da
MD5 f4d02ebff11fbbf0925736c836a077cc
BLAKE2b-256 bc4a25a2ef0242ab05abda1a5333cf27e09afcb1efda8d67ea5cb2360778a992

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 2ecdfe9736c4a73343f629586016a137a10faed1a29c6dc699d8ab20c2d3cf64
MD5 5ec106b5d350bb33fb0981a9ac25dfab
BLAKE2b-256 80a8aaf102eaa260f8311d689bbdf11f880a38fc5c68108635e640be1a8a9c14

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 7618b84118ae704f7fa23c4a190bd80fc605671841a4427d5ca14b9b8d9ec1a3
MD5 9a66f04417a57edc0f2d8b2456700668
BLAKE2b-256 6159cda5bed9bdd1d182c3e5f84e79782e74fa209b4ec1296c6baa3436adf9ad

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 040ee44efc1806900de72b13c1c3036154077d9cde189c9a7e7a50bbbdcbf39f
MD5 1a35c7be7bac5c36304bdd11003c293b
BLAKE2b-256 91687dadc4d784d273a281c4c87376a62c9ebfc8e57413c08c815f4ec2756756

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 df4f058e96e8b467b7742e5dba7564255cd482d3c1e6cf81f8cb683bb0433340
MD5 5f4dd6455cce8d655a9cc3f428cb30cb
BLAKE2b-256 a5136dbf3a2b2e437a4e065c2281ec17014fba75d1d0cc8845488cfb89f990a7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 102f118fa9b720b93c3217c1e239ed7bc1ae1e8dbfe9b4983a4f2d7b4ce6f2ec
MD5 13f723d1644167008d113dc5117289e0
BLAKE2b-256 35a2b95c945f9bbb8f84554f80d3fd3a905df527617a0b208382c18023161272

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 ca304402ea66d58f99c05aa3d7a6052faea61e5a8313b94f6bc36fbf27960e2d
MD5 9b06003fc8a7a1aed3d6ce73d311dca3
BLAKE2b-256 6c7aeabe07a370f776d0ed342b68a2936fbe199b4b16f200d9d1a3cd0cec3be9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 d091c62cb7abbd32e527a85c41f7c8eb4526a926251891fc4ecbe5f974142ffb
MD5 503647103c36cec0b91e000540dc4e39
BLAKE2b-256 4ba209adfab0ebebffc353fe0067248e7deed108dee3e5dc32cb58b5de031b99

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 26fee36a6d8f2bd9464f3566b95e3e3fb7fd7dad723f775c500aac8204ec98c6
MD5 f7d949fbeb3fe04e32020313458d2031
BLAKE2b-256 2473f3fed6047027e388ab0aefca0ca7aab57a6b74cccc758e4a4135d07a91ab

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 ad759ba39cd32c2c2247864d02c84ea5883b5f6cc6a4ee0c95602a3dde52268f
MD5 6ec9549dc1cddaecfae3bbd03a89a669
BLAKE2b-256 6bf727eae8224fdfce53117edde03b750b23d84b31032f60928712988f45f481

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 a7093767e070269e22e2c5f845e46510304f124c32d2cd249633c0f27eb29d86
MD5 0e6dc01a8701b19506eed14bf49023ea
BLAKE2b-256 ca94477da2b516f8a0e8ca542f21c6e579461dcdd3ad5dd666306d840e91b481

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 ca0bfc79b27d84fcb7fa09339b2ee39077896738d9a30ff99c0332376e985072
MD5 12941015bb2c371ab6c322d260d69a9f
BLAKE2b-256 1eb6915f9cabcb21b84a4c535f6a99a3d4708222fc7218c967e96f7bdae51d88

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 2cda65b689aec63b7c76a77f43a08044fa90bbc6ad9849267cedfee9795913f3
MD5 c27e395b08f60f6d41dcbe058460bf42
BLAKE2b-256 5554c07b4aa392c0d938507042c9a5d119ff3ff1d7121052fb5cec712c49d1ce

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 319e4367596fb0d52be645b3de1616faf0fadaf28507ce1c7595bebd9b4c402c
MD5 2626714bc67e08ac8bc5f751f91fbf2e
BLAKE2b-256 85bf6d8094563c6e5277f0788b0b88e96ad11ab9bee57b5b289e8f7886c76722

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 42b180ed1bec58ab9bdc65d406577e0c0fb7241b74b8c032846073c7743c9f86
MD5 f4a6678a7114fc2ebb8127a4b402e69c
BLAKE2b-256 4334fdf6c2d893b02f315207d7fd4bd1f4dea26aec2514ce2adb41a464fb8f21

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 3678be5db330726f19c1949d8ae1b845a02eeb2a2e1d5a8bb8eaa82087ae25c1
MD5 3431dde1f7495a240587b42717510151
BLAKE2b-256 d06690c149a8c34555d377d8fe286354dcc628d6aa83859fb2aa116583a1ce66

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 d49567a2754e9991c05c2b5a7e6650b56e24365b7cab504558e58033dcf0edc4
MD5 a184574e38bf319cc5b6fb34a681be82
BLAKE2b-256 b989dffe9290f3346776377485dc0fea9aea16277a217889c259c29fcb459d6f

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 9930f31f603ecc6ea54d5c6dfa299f926ab3e921f72f94babcb02598c32b57c6
MD5 8a335cbe86974b106dcc2197fe8668c4
BLAKE2b-256 4760ce26174c61ec4be36779068a2556ca67ec30a3817aac8061ceb79ea8aff5

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 fe2ea1177146a7ab345ab61e90a490eeea25d5f063e1cb9d4eb1425b169b64d7
MD5 b3ac8f5207d9f39fca849f032c5c1261
BLAKE2b-256 94366b195fb6488f24017570da95007b6fc4c487c6a530f2c0ebe783c9504edb

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 acfc8db61c6e919d932448cc7985b85e330c8d745528e12fce6e62d40d268bce
MD5 c24836f90a8af43702e70056f81ad89a
BLAKE2b-256 dc68110cdce48f9a6852d78e6f156fa55c9da4510a070904819390ade326a35b

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 1ff516d129f01bb7a4aa95bc6aae88e4d86dd63bfc2d57db9302c2624d1be7cb
MD5 ce6c558358e64e642c685de474c0baec
BLAKE2b-256 56b3f5ebafd2030e4c0010d32e438df51275763b90c0d394f9072dedc0b5a29c

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 44f1748035c36c939848c935715bde41734d9249ab7b844ff9bfbe984be8952c
MD5 5cffa06d02a434fe0a0e41b720e8a880
BLAKE2b-256 23fd0513f3c8895167e338511332467bf9bdcf0a73e634d7622077a7f2e239bf

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 91d32bd1056c0e83a0f90e4ffa213c25096b2d8b9f0e2d172a45f138c7d8c081
MD5 dcb94a65e6a6e191d3efdc825d815378
BLAKE2b-256 9e4bbd2aed530f100c043372dfb2f432177896ec6ec803e8a809c99e435d0541

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 08e55920b453c30b46d58accc68a38e8e7488d0c03babfdb29c55d3f39dd2052
MD5 4c0d7d652deaf834828fb00a1443598f
BLAKE2b-256 1f236d68048cf7bf687aa1da83bcc0ca1e1e6eaf8e6ea7302ea0107fcbaebf99

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 89cbeec7e9d5d8773ec4779c64e3cbcbff53d234ca6ad7b1a3736588003bba48
MD5 52d63116e7f666496acea82c8fbe3c16
BLAKE2b-256 99b87c8ab4f9c6cc0a839c8237013b60597d31cb65e73a8a96446971d8191ef3

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 e9f27399b8d50c5d3f08f0aae961bcc66a1dead1cd0ae9401e4c2a43a623322a
MD5 8b903969f79a16609f6dfb32223f2627
BLAKE2b-256 12bc378f6edcacb57671221af1ae349af2240de8fdbadea06e7bef47e7cfbac1

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 0c8ee283b249c3c3c201c41bc23adc3be2514ae4121eacdb5c5250a461eaa8c6
MD5 f9b5f0c0a1f04a943fa6bb0c5bb236e0
BLAKE2b-256 e0fb3f685d80afcec387e5bfc9656c07674095427fdf9cc72a9c2500744c98d3

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 50f03d2330a153a9114c2429061137bd323736059f384de8348d7cb1ca1baa15
MD5 1e527809333da40dd14fdef38af38c20
BLAKE2b-256 412bb37225ab8ca6d58c04682556f0c1a0d5e43d76717eefa7d53eab6421cb37

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 c375161b588982be381c43eb7158c250f430793d0f708ce379a0f196164c6778
MD5 6573b121a8c6bbf58817b1964fb0398a
BLAKE2b-256 2e510686faa5aad8ceae47a611f37c363df1e5c09c4db8dfe9b833e8728bc6a7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-none-win_amd64.whl
Algorithm Hash digest
SHA256 c65d76052561c60e17cb4fa289885ed00a9995d59e97019fac2138bd45142057
MD5 bf4ce65bad9f9c9f865d4d92d0bb9971
BLAKE2b-256 c3290d9975fb739bdbefc73b6c23f335ea18e752fe6d2e91f3266a10dc8be140

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.1-cp311-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.11, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.1-cp311-none-win32.whl
Algorithm Hash digest
SHA256 8db3a6f3d430ac3dc3793c53fa8e5e665c23ba359484d365a191027ad8b65a30
MD5 72b9beecd6db1e2a9fd8c77fc01eb1fe
BLAKE2b-256 23079ef6839f11c00be9ee27a175df57d54aec162feddad9b1c07f8ad1ebde93

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 c84d3cb1349936c2b96ca6175b50f5a9518170bffd76464219ee0ea6022a64a7
MD5 db00b6ca0415057dc10c0124175dc44e
BLAKE2b-256 c8e96671d233e76f88bc932a5a43a3010401ce6c30f5606e0421d62989996b00

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 db96cf092d86d4cb543daa9148e299011e0a40770380bb78333b9fd700586fcb
MD5 5e2b1fcb5a27c18ec94147a7a1d147b2
BLAKE2b-256 f988101149fb1d7919f6946848875c57a4775e373dd0d9c26f31b9bf667c50e7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 37cc955c84ec67c2d11183d372044399342b20a1fa447b7a33040f4889bba318
MD5 fe7d2fe0a6a013c26192bc27d9d7ab4d
BLAKE2b-256 817868f6a9421de8d0f936caa39ec0af493c694c2ecdb1784788b6f9f5447cb4

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 72d9967fb1f927542cfb5347207fde01b29f25c9bb8cbc7ced280decfa015983
MD5 e281ef7ed789f479119fb112c7291d4f
BLAKE2b-256 a4b85c956f560593630b8b0799b5b75aefc9ea80749213655c72bfd7ec554d1e

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 bfe164a1c72c6be3c5c26753c6c412f81412f4dae0d7d06371e0b396a9cc0fc9
MD5 8aa9a9e40cc1bf88b566a7de9876b2c7
BLAKE2b-256 fdf487c2476afd107e5508bf3eb4090c627305d5785262f5d81bb210cc71da84

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 c11444984aecd342f0cf160c3320288edeb1763871fbb560ed466654b2a7016c
MD5 ae607ad5e00069e6223279289130bdc7
BLAKE2b-256 3a7a49ba6d71683194005e33fb47930ec1d87cd37e051f7eec030399b51089c7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 e448b2be0430ab839cf7954715c39d6f34ff6cf2b49393f336283b7a59f485af
MD5 f31f0a50473a11ccfc36685213b58ad1
BLAKE2b-256 c733b7ec18a7d479d83f62932434ea4cf9417f7d7e127b3ce8e540e9a616a1a4

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 a480bd902e327dfcaa52b7dd14fdc71e7aa45d73a3d6e41e028a75891d2823cf
MD5 7a594bcd1585d57b9d2e9b001ccf0dec
BLAKE2b-256 1fc23a972b19533988b778cab07f22703c7e92510081693faf536d4ed9fe9399

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 fee553657dcdb7e73df8823c49e8611457ba46e9d7026b7e9c44820c08c327c3
MD5 4e74adb1cd7da7ce92792251cea61c76
BLAKE2b-256 7e8e9c0f7799da9a690ec29a7a7b6c0744d3f735e40951d2f62c8202faf3df6a

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 00df4c5bf25c153b432b98689609b426ae701a44f3d8074dcb619f410bc2a870
MD5 59c80ab07a006d44a8778d8146fc23dd
BLAKE2b-256 a1e980f82aaa756e1345f80baba24af40eda58009560fa5263ff1b2a1ac32e7d

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-none-win_amd64.whl
Algorithm Hash digest
SHA256 c2c659f2106b6d154f118ad1b700e68148c46c59b720f04867b1fc5f26a85060
MD5 a2da3611d214126e40643420ecd4de60
BLAKE2b-256 920215556b80450301d2ef014bc598df4352bfb39631c5fcff758d8e0ac9f065

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.1-cp310-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.10, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.1-cp310-none-win32.whl
Algorithm Hash digest
SHA256 370b5b86da9bddbe65fa08711f0e8ffdf8b0036558178d1a31dfcb44efcde72a
MD5 d694b1b1f7a9d470118979b336c26460
BLAKE2b-256 cc9dd5f671c53aa4d79f5fa94daf7adfc07b8456c0cfbca94d10eb104b96f8a6

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 a1e30a13376db5329570e09b14c8eb36c017909ed7e88591ca3aa81f3c7d6f32
MD5 bb8ea10c176bfc3e9d62245cecfa02a7
BLAKE2b-256 162cf6bb90547b89d46a39bdc758cb82e5634fed3acd6381e701ef59149f4ef8

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 930c19b699dd7e1077eac98967adc2fe5f0b104bd96cc1f26778ab82b31ceb24
MD5 cfde4472f1c74a646959c234872be5e6
BLAKE2b-256 a7d01e492762398d10cb0f2d7fb979ce0a58347de71d38336ba1b1b087fac015

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 60fec380778d75cbb492f14ca974f11f37b41d53c057b9c8ba213315b86e1f84
MD5 74684eda7b3d97719facf540ffd5b5a8
BLAKE2b-256 a77bc1f643eb086b6c5c33eef0c3752e37624bd23e4cbc9f1332748f1c6252d1

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 6cba7483ba45600346a35c466bde32327b108575022f73c35a0f7170b5a71ae2
MD5 2fe8b29fd70a6b7ddd555dbe4b735e39
BLAKE2b-256 f2b12c9bda0be70f3bf83d20d05668646bea626ff33553363afa0a984806c740

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 d3a6330c9f1deda22873e8b4ac849cc06d3ff33d60b3217ac0bb397b541e1509
MD5 8c6f62ed95624ac54d6f476216d3c97a
BLAKE2b-256 9b0f6f3bc4f60f5769c897094183fbf28f03eeca86e61831af0f739b576a898c

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 ebefbc26ccff5e96ae7d40772172e7310174f9aa3683d2870a1882313ec3a4d5
MD5 4c4813670e6966feb0326c76d9e308a6
BLAKE2b-256 6113df6b0b6bb2c29197b6ab1b62e61b979e76ce1b7c079fb6f1efcf5ce6e92a

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 72e95184bf5b9a4c08153ed07c16c130ff174835c9a1e6ee2b311be758c8b3ef
MD5 f2cf7b5ae77e4670ede7941a2cc95aeb
BLAKE2b-256 ffbce1354f34c1a83ddceaa66a0027fad01959f28cfbc26a203631d3a88bd80f

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 901635098565773a44f74068639d265f19deaaca47ea77b428fd9bee13a61d87
MD5 659de598695aa1f3726c9a7b5c55ffbb
BLAKE2b-256 94ffc16923e36a620f7d25751904cd40ec2abaefc76c795ff490fc217abcae84

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 638abedb39375f0ddce2de536fc9c976639b2d1b7202d715c2e7a25f0ebfd091
MD5 605daf4fc265e6fe1b00ef819e9dc80d
BLAKE2b-256 ec2db0ce807327959036aad8431304a1e4a115efe678d68920f6cd192152c17b

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 04ec1134a18ede355a05641cdc7700f17280e01f69f2f315769f02f7e295cf1e
MD5 554d58a64ebd2e6fb5a3b1134e9a2922
BLAKE2b-256 f43e3e8800424cee3d3097f84ca1a70311a4fdf14646f6cff934512c619c9ebe

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-none-win_amd64.whl
Algorithm Hash digest
SHA256 68c4699147dded6926a3d2c2f948d435d54d027f69909e0ef3c6587933723ed2
MD5 852392e41dbc8a2be00afe70c55c9b4a
BLAKE2b-256 36dede1b1d7b191821cc2e6e84251cf9641e4fbd205fa5ec816d52fe42f97325

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.1-cp39-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.9, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.1-cp39-none-win32.whl
Algorithm Hash digest
SHA256 aae42798ba1da3bc1572b2048fe42e61dd6bacced2b424cb0f5572c5432f79c2
MD5 56b35eb6bba836934b4e81f856ba64a0
BLAKE2b-256 a790fe9aac3b32435c96401bf817629505e337075d0258a01542529e4db2f128

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 ee6b63aecf929a7bcf885bdc8a8aec96c43bc4442f63fe8c6d48f24fc992b05b
MD5 421edefd73b798e38c2af0af827e7854
BLAKE2b-256 e5ed9ba68385a87787e84597e18af549eba6f0e410a465f50a65c852344ce8c6

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 463ee5f3afbfec29cbf5652752c9d1032bdad63daf48bb8cb9970064cc81d5f9
MD5 fb153994f2e0407257b7fee990e21034
BLAKE2b-256 cdcd87acdc641ea8678f0dde48718dd669ae39153e0352496109792fa77d30fa

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 c84b456ff8525ec3ff09762e32ccc27888d036dcd0ba2883e1db491e164dd725
MD5 7b34b8e157f0d5feb1b7b4d984c20b5a
BLAKE2b-256 c5c0fab17cd02d68d4b62f09f47a30d03cd3e9acd0e59bbc23006d0a84a4989e

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 5760a831c0f3c6d3229b50ef3fafa4c164ec99d7e8c2237fe144e67a9d33b120
MD5 2b64bb329ddaa0965ccfd874f06f359c
BLAKE2b-256 3cdde21f379bc1326003e1da6d43dff90d465139c2c0ed1155db3f5e165d8eb3

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 8e63781da85aa8948864970e529af10abc4084a990d30850c41bbdb5f83eee45
MD5 cd443c05d65524f2f7342e4954801439
BLAKE2b-256 037fb37d3c65c19bbda8519a5bd372b5ece9037644818a0f694a4959d8c69788

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 232445e7b85255ccfe68dfd42185db8a3f3349b34ad7068404856c4a5f67c355
MD5 e074f7c722809622a72ee5b21eeac819
BLAKE2b-256 7f83dc9edef52c7e7ef7f48a34cced812ca5497700039d4239b018881633887c

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 59c7df2103052b30b7c76d4fa8251326c9f82689578a912698a127dc1737f43e
MD5 01be011a85479c5e012c5c90e958f79d
BLAKE2b-256 5cf05675a7afc582800a030b478d60d2fc6cf26a2d255c859e86ec8b75f23b17

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 5bef76c4d9329913cef2fe79ce1f4dab98f77fa4887e5f0420ffc9386941de32
MD5 47b197db0ca0202a60d5c0396f5ba4f0
BLAKE2b-256 7f70654690cef99930703eb3666136bcd99f4e416266604a3fb4795be6d95804

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f522f28c88a0d5b2f9e895cf405dd594cd518e99d61905406aec74d30eb6383b
MD5 37d5c1a030334c5647e97a4448a2b574
BLAKE2b-256 087eb6e30248aa2c6264383236d993b835876741beb728a9487f5aa12a4c068d

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 b886e0f5c72aa4249c609c24b9610a9ca83fd963cbb5066b19302723ea505279
MD5 987676895005aff01a184555a81578de
BLAKE2b-256 4751a921331f1a45a2dd689286720596d47a3a275c919e1de2c6f31985a7d11d

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-none-win_amd64.whl
Algorithm Hash digest
SHA256 c318a5acb429ca38f632577754235140bbb8c5a27faca1c51b43fbf575596e34
MD5 05a0e7972db446d8459121287308d5d4
BLAKE2b-256 c9e6200dc81fb3445f61bfed50e778794126d5d479560e7f92eaedf1969f6cd0

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.1-cp38-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.8, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.1-cp38-none-win32.whl
Algorithm Hash digest
SHA256 7560fca3e17a6bc876d20cd825d7721c101fa2b1cd0bfa0abf9a2e781e49b37b
MD5 672235cae1073350b8e5bdf05d7be79e
BLAKE2b-256 902d34e8889313b089de1f184fd4957521f66d6f800fa3a6618546c557872722

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 e3b6082e9532309727273443c8943bb9558d52e36788b246aa278bda7c642116
MD5 ebf3d78e0a03e8a12a5c3421189e9af0
BLAKE2b-256 58f647a70baea0337f7bfe1bd09b1215a2f06bc64e9a80d057b499477ac403a0

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 53614f44f36917282a583180e402105bc63d61d1aca067d51cb7f051eb489901
MD5 06df586157f48626007445f27a3818bb
BLAKE2b-256 4fe73838f0aa33a2e65835009b27a2e956f8cdf5b8aaea7bc0f83bdae025177a

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 11284b32f0036fe7ef4b8b00201dda79c00f3fcea173bc0e5c599e09c937ab0f
MD5 025e6d3557ea6ac927dafff731dd43b4
BLAKE2b-256 76ee7e35fb46c728989357e6ccb96df64c4364601cfbfdd6c25ccc872e6c16a0

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 e8984114fd83ed3913d89526c992395920930c9620a2feee61faf035f41d7b9a
MD5 ecff71531ffb4bb9476422e5c3bcea2f
BLAKE2b-256 5679443b00bbbc66a6b187fdd7aa2585d8996f30ca295f20517ebb9f43f6c709

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 8b019c4810903fdea3b230f358b9d27377c0f38454778b607676c9e1b57d14b7
MD5 95b9e17da160f95e20f292b819997ce7
BLAKE2b-256 a75b26d6d2e312796c3609d6f7a6b63cee2b2966077dcf4b6e89d6fcf701df52

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 ec8f46d533092d8e20bc742c47918cbe24b8641dbfbbcb83177c5de3c9d4decb
MD5 82d943ea582484a89a4ba861ce8c7c6a
BLAKE2b-256 7c22ce99702ccc497b8e54c96a913b5bbf4beb260344d0e3f41465278492dcb9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 2539831838ab5393f78a893d7bbf27d5c36e43baf77e91dc9992922b2b97e09d
MD5 45af1e6a7e80ffd5e6e3c717ce13b68d
BLAKE2b-256 ba9db399122b946274a003f267c0868c81062383b5c67bb593845449b9931d75

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 7d9025b185465d9d18679406f6f394850347d5ed2681efc203539d800f36f459
MD5 96369d13908010bdcbdcc6b68c260278
BLAKE2b-256 29a9247b518fd295bf6251ee7155ee4e93a3caaaa1c17449ad095ed65b871a66

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b05ec04132394c20bd6bcb692d557a8eb8ab1bac1646d28e49c67c00907d17c8
MD5 7893e36f39951b1e71e7a16776e6c98d
BLAKE2b-256 a2fc487e26b9983823890f0022f330073a2ba677217db6499abdbf7ba4d4f51a

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 01d2bd5935642de22a6c6778bb2307f9949cd6eaeeb5c77f9b98f0060b69f0db
MD5 2ecb396555d6d8e6a0ac2a3130bab1e8
BLAKE2b-256 5316b7474f86e39e8771ee75011b107ef332e5b17f3ce4e06156cdb0d4c40df4

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-none-win_amd64.whl
Algorithm Hash digest
SHA256 117c8da60d1bd95a6df2692926f36de7971baa1d89ff702fae47b6689a4465ad
MD5 d3c5f5354ea253b2d0850fca344a1753
BLAKE2b-256 6b5e5306809d60c82644f9b206cfa5ecf70caf4d0789c9445315d6bbf87ee500

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.1-cp37-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.7, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.1-cp37-none-win32.whl
Algorithm Hash digest
SHA256 49f5336b82e315a33bef1025d247ca08d95719715b29e33f0e9e8cf15ff1dfb6
MD5 0f3b634af78e46f74b2f5650210eecca
BLAKE2b-256 9b2372905ddeed855214c8a1e3332c7475d2af2c0d6ed6c355294bfa8f507664

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 a687099e085f5162e5b88b3402adb6c2b41046180c015c5075c9504440b6e971
MD5 cc91be22caae3b3d0339574a245791b9
BLAKE2b-256 a6f2ae420b671e17a54c8595681e7b214f93f3c67263bfe6003e3af93f9f84c7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 ff66577ae55114f7d0f6aa0d4d335f27cae96bf245962a745b718ec887bbe7eb
MD5 aa6933cd4ece59535716023bcffb2ad3
BLAKE2b-256 7d6d5e9ab2ba7c80a3875b067a174a172b6e6a8a6ee31d0f16a10ac4080ae1ec

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 cce4d1a97a7eb2253b5d3f29f4a478d8c37ba0303ea34024eb9e65506d4209f8
MD5 f3ea51367cf95950d597e6a99489645b
BLAKE2b-256 0e9b8ef4a8d2b2edce1a702f2ac0ae424e334b2ce8f0eeea84f27ea863ae6785

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 f475d5eda41d2ed51ca775a07c80529a923dd759fcff7abf03ccdd83d9f7564e
MD5 34f23a2efca67d193e21d980be9031d9
BLAKE2b-256 be16be2117b48219391c760ea3d0d1b8ab87e55ab030f8e95b91f0267adc4b21

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 f8cf2fcdc2368df4317e05571e33810eeed24cd594acc9dfc9788b21dac6b3a8
MD5 3f09569ecbb83499f400b01389cb087b
BLAKE2b-256 b444e25e67f17ba7cef11b2f9d0fe282daf59f68575b5fa41672e162714c67ec

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 cb3c6bc6e599e46a26ad559ad5dec260ffdf705663cc9b894033d64a69314e86
MD5 9c6d7a7a0e5c7fadc5236dfac224b1b6
BLAKE2b-256 203551f6988c8c90e2791b8810f220beea56bfc0d0155450dc37ac8738e43781

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 caf0df8657277e32671aa8a4d3cc05f2050ab19d9b49447f2265304168e9032c
MD5 75cfb2b75fe090a2e64026fec707bf07
BLAKE2b-256 a00f3234e243b81cd058440bdf76cabdfa459a53f8a34b08144b17f4a45b16e8

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 d72d25c57a9c814240802d188ff0a808b701e2dd2bf1c64721c7088ceeeb1ed7
MD5 15b801753e1f40e41d1e1d44bc075059
BLAKE2b-256 82e1dd0a679a0514fbbf78c7d6c460e0d15a918ac93229045477ee3323fee43a

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f77371b5030e53f8bf92197640af437539e3bba1bc8342b97888c8e26567bfdc
MD5 75a1c648cc79af188b39d1192aa14a0e
BLAKE2b-256 6a4fa71ef5365db2d96b3fab59bbb06f8fcb87f7b25a882c3daf40e17eb3b1bf

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 ba336bc9107acbc1da2ad30967df7b2db93448ca66538ad86aa1fbb91116f631
MD5 b50bb9a44bd249159020b8da16cd986f
BLAKE2b-256 6654fdb0d15b3a9bc7aaf61747d039c3402247874a4d7188602b05074ada3eba

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page