No project description provided

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Project description



Build GitHub


Tokenizers

Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Bindings over the Rust implementation. If you are interested in the High-level design, you can go check it there.

Otherwise, let's dive in!

Main features:

  • Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3 most common BPE versions).
  • Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes less than 20 seconds to tokenize a GB of text on a server's CPU.
  • Easy to use, but also extremely versatile.
  • Designed for research and production.
  • Normalization comes with alignments tracking. It's always possible to get the part of the original sentence that corresponds to a given token.
  • Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.

Installation

With pip:

pip install tokenizers

From sources:

To use this method, you need to have the Rust installed:

# Install with:
curl https://sh.rustup.rs -sSf | sh -s -- -y
export PATH="$HOME/.cargo/bin:$PATH"

Once Rust is installed, you can compile doing the following

git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python

# Create a virtual env (you can use yours as well)
python -m venv .env
source .env/bin/activate

# Install `tokenizers` in the current virtual env
pip install -e .

Load a pretrained tokenizer from the Hub

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_pretrained("bert-base-cased")

Using the provided Tokenizers

We provide some pre-build tokenizers to cover the most common cases. You can easily load one of these using some vocab.json and merges.txt files:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
vocab = "./path/to/vocab.json"
merges = "./path/to/merges.txt"
tokenizer = CharBPETokenizer(vocab, merges)

# And then encode:
encoded = tokenizer.encode("I can feel the magic, can you?")
print(encoded.ids)
print(encoded.tokens)

And you can train them just as simply:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
tokenizer = CharBPETokenizer()

# Then train it!
tokenizer.train([ "./path/to/files/1.txt", "./path/to/files/2.txt" ])

# Now, let's use it:
encoded = tokenizer.encode("I can feel the magic, can you?")

# And finally save it somewhere
tokenizer.save("./path/to/directory/my-bpe.tokenizer.json")

Provided Tokenizers

  • CharBPETokenizer: The original BPE
  • ByteLevelBPETokenizer: The byte level version of the BPE
  • SentencePieceBPETokenizer: A BPE implementation compatible with the one used by SentencePiece
  • BertWordPieceTokenizer: The famous Bert tokenizer, using WordPiece

All of these can be used and trained as explained above!

Build your own

Whenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer, by putting all the different parts you need together. You can check how we implemented the provided tokenizers and adapt them easily to your own needs.

Building a byte-level BPE

Here is an example showing how to build your own byte-level BPE by putting all the different pieces together, and then saving it to a single file:

from tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors

# Initialize a tokenizer
tokenizer = Tokenizer(models.BPE())

# Customize pre-tokenization and decoding
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.ByteLevel(trim_offsets=True)

# And then train
trainer = trainers.BpeTrainer(
    vocab_size=20000,
    min_frequency=2,
    initial_alphabet=pre_tokenizers.ByteLevel.alphabet()
)
tokenizer.train([
    "./path/to/dataset/1.txt",
    "./path/to/dataset/2.txt",
    "./path/to/dataset/3.txt"
], trainer=trainer)

# And Save it
tokenizer.save("byte-level-bpe.tokenizer.json", pretty=True)

Now, when you want to use this tokenizer, this is as simple as:

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_file("byte-level-bpe.tokenizer.json")

encoded = tokenizer.encode("I can feel the magic, can you?")

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Release history Release notifications | RSS feed

0.20.3

0.20.3rc0 pre-release

0.20.2

0.20.1

0.20.1rc1 pre-release

0.20.0

0.20.0rc1 pre-release

0.19.1

0.19.0

0.15.2

0.15.2rc1 pre-release

0.15.1

0.15.0

0.14.1

This version

0.14.0

0.13.3

0.13.2

0.13.1

0.13.0

0.12.1

0.12.0 yanked

Reason this release was yanked:

Breaking change with unexpected effect

0.11.6

0.11.5

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.3

0.10.2

0.10.1

0.10.1rc1 pre-release

0.10.0

0.10.0rc1 pre-release

0.9.4

0.9.3

0.9.2

0.9.1

0.9.0

0.9.0rc2 pre-release

0.9.0rc1 pre-release

0.9.0.dev4 pre-release

0.9.0.dev3 pre-release

0.9.0.dev2 pre-release

0.9.0.dev1 pre-release

0.9.0.dev0 pre-release

0.8.1

0.8.1rc2 pre-release

0.8.1rc1 pre-release

0.8.0

0.8.0rc4 pre-release

0.8.0rc3 pre-release

0.8.0rc2 pre-release

0.8.0rc1 pre-release

0.8.0.dev2 pre-release

0.8.0.dev1 pre-release

0.8.0.dev0 pre-release

0.7.0

0.7.0rc7 pre-release

0.7.0rc6 pre-release

0.7.0rc5 pre-release

0.7.0rc4 pre-release

0.7.0rc3 pre-release

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.5.2

0.5.1

0.5.0

0.4.2

0.4.1

0.4.0

0.3.0

0.2.1

0.2.0

0.1.1

0.1.0

0.0.13

0.0.12

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenizers-0.14.0.tar.gz (286.7 kB view details)

Uploaded Source

Built Distributions

tokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ s390x

tokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.12+ i686

tokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

tokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.12 macOS 10.7+ x86-64

tokenizers-0.14.0-cp311-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.11 Windows x86-64

tokenizers-0.14.0-cp311-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.11 Windows x86

tokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ s390x

tokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.12+ i686

tokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

tokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.11 macOS 10.7+ x86-64

tokenizers-0.14.0-cp310-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.10 Windows x86-64

tokenizers-0.14.0-cp310-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.10 Windows x86

tokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ s390x

tokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.12+ i686

tokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.10 macOS 10.7+ x86-64

tokenizers-0.14.0-cp39-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.9 Windows x86-64

tokenizers-0.14.0-cp39-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.9 Windows x86

tokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ s390x

tokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.12+ i686

tokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

tokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.9 macOS 10.7+ x86-64

tokenizers-0.14.0-cp38-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.8 Windows x86-64

tokenizers-0.14.0-cp38-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.8 Windows x86

tokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ s390x

tokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.12+ i686

tokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.8 macOS 11.0+ ARM64

tokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.8 macOS 10.7+ x86-64

tokenizers-0.14.0-cp37-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.7 Windows x86-64

tokenizers-0.14.0-cp37-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.7 Windows x86

tokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ x86-64

tokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whl (3.9 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ ARM64

tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.4 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ s390x

tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ppc64le

tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARMv7l

tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

tokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ i686

tokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.7m macOS 11.0+ ARM64

tokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.7m macOS 10.7+ x86-64

File details

Details for the file tokenizers-0.14.0.tar.gz.

File metadata

  • Download URL: tokenizers-0.14.0.tar.gz
  • Upload date:
  • Size: 286.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.0.tar.gz
Algorithm Hash digest
SHA256 a06efa1f19dcc0e9bd0f4ffbf963cb0217af92a9694f68fe7eee5e1c6ddc4bde
MD5 3388295d0ede4462c55ddf99f34e4f85
BLAKE2b-256 cee98dbbc014c48d73ca8eb86bccec15f857ad2e86f9d16a44b7d11ec145c0c2

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 4caf274a9ba944eb83bc695beef95abe24ce112907fb06217875894d8a4f62b8
MD5 d7cad839a8a08d923538e7276b4fc4ca
BLAKE2b-256 4ffa6a5630da35210c24dd4930af86b62e6aa129475e4bf0a4d4d73712c0f026

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 419a38b89be0081d872eac09449c03cd6589c2ee47461184592ee4b1ad93af1d
MD5 83bd0b790506fe13ae2698c0159dde49
BLAKE2b-256 7fe837e50faced969c4b43d7f58c2c6f25d3c9b84df203d471939c2e8d7cce17

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 3d8cd05f73d1ce875a23bfdb3a572417c0f46927c6070ca43a7f6f044c3d6605
MD5 ad3c2c351d3fe60e114d512307dca0b8
BLAKE2b-256 e34ebef75b850018710cc1f0f5170aa2aa5a126fbf9f622f26bb00c9e0770670

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 81876cefea043963abf6c92e0cf73ce6ee10bdc43245b6565ce82c0305c2e613
MD5 c088c74adb0a92e03583fd970246eab2
BLAKE2b-256 1dd58e0c49b9a76627c681e65b9bf72344ff8f1a3df6c28715e2607ed2022015

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 4a7e6e7989ba77a20c33f7a8a45e0f5b3e7530b2deddad2c3b2a58b323156134
MD5 f15b3d8f4d4f1f232aaee34a4063ecda
BLAKE2b-256 73e29233d04f973a2bf9ebce041df8998521d693970c645bbfa9c0b9f1e26b92

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6d17d5eb38ccc2f615a7a3692dfa285abe22a1e6d73bbfd753599e34ceee511c
MD5 e443feeb286237f97559ec79ae082f1b
BLAKE2b-256 7bc47c7ae94003aad44875166e159cbc71781db10d079d5d8278393668c4f35e

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 b45704d5175499387e33a1dd5c8d49ab4d7ef3c36a9ba8a410bb3e68d10f80a0
MD5 86313e235cc83c2c94bf8f2c48707d92
BLAKE2b-256 2d6c38c9e27d3738952e030c2682e94d8ecfed9597d8221ae8529e1a78f18c69

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 27ad1c02fdd74dcf3502fafb87393412e65f698f2e3aba4ad568a1f3b43d5c9f
MD5 f1cf4fcd618aded82bd9d717bdf7523d
BLAKE2b-256 5c15b33e6c405219d3b790b0eb65c582435f2f4e69f43d760b43bad04dea6f6e

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 b611d96b96957cb2f39560c77cc35d2fcb28c13d5b7d741412e0edfdb6f670a8
MD5 fb21a1d6b555527d3605d4d3c9c80f59
BLAKE2b-256 25b13c09ee36bc9bff94c82a0442d27bbd87bbc09b5086c2f80ed9822db423ca

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a00cdfb40544656b7a3b176049d63227d5e53cf2574912514ebb4b9da976aaa1
MD5 a3ddf8e11bc6416689e10697785f796d
BLAKE2b-256 dcaa3fb2cfc868f4aac9e088821546aa2483f873acbe1c556a3a0d445dd555f2

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 9f64cdff8c0454295b739d77e25cff7264fa9822296395e60cbfecc7f66d88fb
MD5 e2b59946547585da110f84245e2791b4
BLAKE2b-256 9e1a8a121ea74564dc2d52f469335254c90bfa21afa9d1c5c7ce83265f6b4303

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 ca9b0536fd5f03f62427230e85d9d57f9eed644ab74c319ae4877c9144356aed
MD5 3bfcec9a3404d5695ccdd47886d04242
BLAKE2b-256 8b40c72953566f699ba6f7a5802cf0cad8fc258b9681a6647b1e15c286e78dd5

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 27244e96810434cf705f317e9b74a1163cd2be20bdbd3ed6b96dae1914a6778c
MD5 0083ffc61c4ceed69f8ade5aaccee345
BLAKE2b-256 1acbeb42081446d0be870518e142ad1059cfa1d29df2945ba060688ee153be3d

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 3d3c9e286ae00b0308903d2ef7b31efc84358109aa41abaa27bd715401c3fef4
MD5 d67876699ca30a80b3995bb2f59510ec
BLAKE2b-256 0b83ef96f1577db7e291911268a305430e0decbdb18708af1f33f7e349251574

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 6a475b5cafc7a740bf33d00334b1f2b434b6124198384d8b511931a891be39ff
MD5 e669bb3dccbad90a347297e6ad43d6b3
BLAKE2b-256 69119097b22700c3e137db3dc8b53719bd93d1165d680a9f992f5e26f2d645a1

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 eb3931d734f1e66b77c2a8e22ebe0c196f127c7a0f48bf9601720a6f85917926
MD5 8a5ac2868df3c2a97d9fee97f08a34ae
BLAKE2b-256 298b2b058171010a874b82be5bf0340ceb2f58d369d7d27bf32eda1a68d18cb7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 7826b79bbbffc2150bf8d621297cc600d8a1ea53992547c4fd39630de10466b4
MD5 5187aa99bba7e2159228a93221c1813a
BLAKE2b-256 13a0e3565993ca8fdc7b171530553db0cbb31eabc86ff27b68bfddc8be655bce

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 d616e1859ffcc8fcda60f556c34338b96fb72ca642f6dafc3b1d2aa1812fb4dd
MD5 0ea150b645fa104d47e1596d4939d138
BLAKE2b-256 cbae4b3605cac0b76c416bdec9f9bdb0132ec4b06cdc5d352caee64dab653c48

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 84118aa60dcbb2686730342a0cb37e54e02fde001f936557223d46b6cd8112cd
MD5 77ad5307c1ce3d606e677f0a640bf839
BLAKE2b-256 f3bf9f20dfe7e1910c62e024550f61194c092b290c86a4a2d0cd49172a815c73

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 99379ec4d7023c07baed85c68983bfad35fd210dfbc256eaafeb842df7f888e3
MD5 97f720ba8305e57b48a907e025c20c6b
BLAKE2b-256 376a082266b840a16089aa7ed64eae7a32dd9c581dc73df63417d9ae38197db5

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 0af26d37c7080688ef606679f3a3d44b63b881de9fa00cc45adc240ba443fd85
MD5 75e96be6d0c9e631790dfdd6d13bc869
BLAKE2b-256 27d8b9db1c2e9b47778e5ecf82c2baafaa0e76ee6140ff3a26709389264977ab

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 1792e6b46b89aba0d501c0497f38c96e5b54735379fd8a07a28f45736ba51bb1
MD5 ee641190f16f7bdef4c1ebea584129bd
BLAKE2b-256 97de6716d1a97d5ee2d242e29eb11dc45f104e84e40d9e5a59af2f52e567c5a7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 493e6932fbca6875fd2e51958f1108ce4c5ae41aa6f2b8017c5f07beaff0a1ac
MD5 a597a21ef0fbdbd5f086aec43f63fe28
BLAKE2b-256 a109db284067185ad7fb155081c671f24cfc92452eeb34d134eacdb50be45138

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b9900291ccd19417128e328a26672390365dab1d230cd00ee7a5e2a0319e2716
MD5 1848e2e76d3d41cd8b1c5e3c91ace0ce
BLAKE2b-256 abce91715838b39be6f84724395df3bf51f1219b8c0c6c40b49a73996b2f508e

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 b4731e0577780d85788ab4f00d54e16e76fe305739396e6fb4c54b89e6fa12de
MD5 4ed05a790c430925566b5dad5edca991
BLAKE2b-256 d04b2bd22fa87644fdc111475d062bb026b110d208f5687650cadb3f26e4da64

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 cb7fe9a383cb2932848e459d0277a681d58ad31aa6ccda204468a8d130a9105c
MD5 02f672ecec6d2690b0f9cb27e1dd1cdb
BLAKE2b-256 315455d9f8a881db5c9e7b7864e2ad68db8243ccf2ca798a422c7d80d79fe7c9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 6ecb3a7741d7ebf65db93d246b102efca112860707e07233f1b88703cb01dbc5
MD5 c2a0794b5101247d5b227a5e7711a568
BLAKE2b-256 a85fd4441bdeaecbddba89466bff1aaa73cb71ca28b025fddb3cff8926002eee

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 9223bcb77a826dbc9fd0efa6bce679a96b1a01005142778bb42ce967581c5951
MD5 75f92f704f73833c4dd8de072bc44f55
BLAKE2b-256 bbe8218bc586caf2d2691aa979eab2b90c28a59fa484c3b664193755a3c9fc62

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 5efd92e44e43f36332b5f3653743dca5a0b72cdabb012f20023e220f01f675cb
MD5 dd04d9a8a7149c28856c9fef2afe59bd
BLAKE2b-256 ecd86a3ce05c02c450ccb1a8e4b38e174a915dae98cb080d21f16d7d5bc48b08

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 07f5c2324326a00c85111081d5eae4da9d64d56abb5883389b3c98bee0b50a7c
MD5 d00d1924dc7659865437d798ced24c7c
BLAKE2b-256 77d4241c762beed43763d32bd6c77c4a33613017b254e4e7cdb1d3d020300148

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 56bc7252530a6a20c6eed19b029914bb9cc781efbe943ca9530856051de99d0f
MD5 7a77195e5b3b41bed2e416ba3d9e1d36
BLAKE2b-256 477261bc88600d1f3c1c57e49064666c6c7335d7279839228ac8957fa19d9056

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 10a34eb1416dcec3c6f9afea459acd18fcc93234687de605a768a987eda589ab
MD5 a6a47d798ecbc1a0a5d5a51751d3331f
BLAKE2b-256 118cbe56c543fb3deea78d9b7e54faacae97378f9143af9ebe6b51904872146a

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 1ddcc2f251bd8a2b2f9a7763ad4468a34cfc4ee3b0fba3cfb34d12c964950cac
MD5 ff5f2e678e0095b975bc3bc9036a9a5c
BLAKE2b-256 321fcf0fb295285e532d8779f1ac597be9e05b359e6b93f5164ef079670bfef4

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 bde333fc56dd5fbbdf2de3067d6c0c129867d33eac81d0ba9b65752ad6ef4208
MD5 4ac1630678958d33b357c6163caf4d63
BLAKE2b-256 2e060a4eee4ee4f5b6dbecfcbda9236e4e5849d3d4720d97c464f512a8e983db

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 24b3ccec65ee6f876cd67251c1dcfa1c318c9beec5a438b134f7e33b667a8b36
MD5 8127ef864aaed6a7051e5d8999c937ec
BLAKE2b-256 59ae3267c5879322dc812945046a0154ed7dccc04f857f6d49fdd4de00618f18

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 84c2b96469b34825557c6fe0bc3154c98d15be58c416a9036ca90afdc9979229
MD5 93cbdfb92b48e210f0ea11bcdc0a3f2b
BLAKE2b-256 8cd39e75282f0c7e2df16c8b50a3dcbe6e7d9607ae6576a3c088959895a393fe

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 8464ee7d43ecd9dd1723f51652f49b979052ea3bcd25329e3df44e950c8444d1
MD5 d1ba4e4dbc2c7ac1f07140c9472286ad
BLAKE2b-256 6e13be51167fcae1e52197c23a13f8082334be641e2f4fd7863a620657a64027

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-none-win_amd64.whl
Algorithm Hash digest
SHA256 917aa6d6615b33d9aa811dcdfb3109e28ff242fbe2cb89ea0b7d3613e444a672
MD5 63eb6f15c0809d6c689ea75a2e628f8f
BLAKE2b-256 588248a40cfa8e7c0f2bdfa7b9655439ce878782f1173504ca819b24ab95267d

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.0-cp311-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.11, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.0-cp311-none-win32.whl
Algorithm Hash digest
SHA256 712ec0e68a399ded8e115e7e25e7017802fa25ee6c36b4eaad88481e50d0c638
MD5 f30f9be5980a02faf6ede3da66fc0884
BLAKE2b-256 d50d6542a778fc758ecdb1d917ef12b9a7469b60563638b45f288c70412dc324

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 095b0b6683a9b76002aa94659f75c09e4359cb291b318d6e77a60965d7a7f138
MD5 dd56a62ead8feff310f60acf14597788
BLAKE2b-256 6041617c486ddba829552e5b3c97fc0110e9100efc016b7e446340099c0c7ad6

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 df763ce657a297eb73008d5907243a7558a45ae0930b38ebcb575a24f8296520
MD5 baadaaf45e21b6d4de808e4f342f37a9
BLAKE2b-256 432143811d27c5eff821261a9c34f68eea28ae5d0644963851bea7beccc081b5

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 9c19f8cdc3e84090464a6e28757f60461388cc8cd41c02c109e180a6b7c571f6
MD5 f2d2f1ead55cfdc3717765594e61351b
BLAKE2b-256 4519bfdbe9504896938cce00cab78b2847d2c1fbda5201704d7bf691699b70b9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 3439d9f858dd9033b69769be5a56eb4fb79fde13fad14fab01edbf2b98033ad9
MD5 7871e5cc6427f467eaf447945b32218e
BLAKE2b-256 baf17a8b4d2396f1d49fd21215bdbc02fed382604c128d0c4ccea7281c25ec70

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 c16fbcd5ef10df9e51cc84238cdb05ee37e4228aaff39c01aa12b0a0409e29b8
MD5 d2181ae92f38a4222c4b3129fd1ea1c5
BLAKE2b-256 2dfebe5aebe8bf6471ca1a599ff6934438adf8bf637bd92f3cafed0833801273

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 8e761fd1af8409c607b11f084dc7cc50f80f08bd426d4f01d1c353b097d2640f
MD5 69b233dffd26cbf43f0b3555e05ca65a
BLAKE2b-256 bad62af7e10d56f5bcaaff4005726076e20d322345ab88686dd252a4305126b3

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 5514417f37fc2ca8159b27853cd992a9a4982e6c51f04bd3ac3f65f68a8fa781
MD5 b348dfcf9d2ebba94302faa67093becf
BLAKE2b-256 852c63fcdd957d20daf609d66c5b92349cb42f7f1d0a414bbcc238fa2440201b

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 c89a0d6d2ec393a6261df71063b1e22bdd7c6ef3d77b8826541b596132bcf524
MD5 e9024cab3938b462fda621541c857ceb
BLAKE2b-256 0c46890401c55b9566895ec18ce4b1ea5134e0d307f6fe4541634b459e795ac7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 3013ad0cff561d9be9ce2cc92b76aa746b4e974f20e5b4158c03860a4c8ffe0f
MD5 48851b5f46abb505e92e24ca8673a8b8
BLAKE2b-256 48eb9a9404720ced1f26f156b5ffcbdb65946621b1111c2cfdd374ee7e7a938e

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 612d0ba4f40f4d41163af9613dac59c902d017dc4166ea4537a476af807d41c3
MD5 94012833b6c4f6d6a13c58bd4b295241
BLAKE2b-256 24d603e086e798b3e17a6a5c8c72edcabe5875e08e5c1d54bc31558da8c96161

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-none-win_amd64.whl
Algorithm Hash digest
SHA256 1c2ce437982717a5e221efa3c546e636f12f325cc3d9d407c91d2905c56593d0
MD5 161a702dbaa3a78e655f28aad880bea5
BLAKE2b-256 f6b913ffa6a2d28e8784a8480ad9c72020cfdccae4e81acc629446d669d75562

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.0-cp310-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.10, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.0-cp310-none-win32.whl
Algorithm Hash digest
SHA256 360706b0c2c6ba10e5e26b7eeb7aef106dbfc0a81ad5ad599a892449b4973b10
MD5 b0b7933ed37f19b8f1c34c37e1bb63fc
BLAKE2b-256 1200e04fea0f847af167557df6437e4ac203ba3fdaf83ce3dc9933f79af4992c

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 25ad4a0f883a311a5b021ed979e21559cb4184242c7446cd36e07d046d1ed4be
MD5 1b374f2d50782996a86d2754700e895a
BLAKE2b-256 977ab5c0acb928c44f6b3ad629509d2aa9bde2d47b5f2de39e6c471ef4556f85

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 98a7ceb767e1079ef2c99f52a4e7b816f2e682b2b6fef02c8eff5000536e54e1
MD5 a4773d009c406b52c85c4b8253d4ff3e
BLAKE2b-256 01125ca0506dfe80d8182b39a81543daa49638873bcfc465af519a000d8fdf51

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 337a7b7d6b32c6f904faee4304987cb018d1488c88b91aa635760999f5631013
MD5 f2ea5345743b5fd71aa4428a7adc48c3
BLAKE2b-256 57bd45b5ef6b088880779f70acf60027f7043ca5fa1b98f4a4345cf3aea09044

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 7f17d5ad725c827d3dc7db2bbe58093a33db2de49bbb639556a6d88d82f0ca19
MD5 227b55853ada038dd942b74bfa875a48
BLAKE2b-256 85d872acb662f95bb2cf9c370470dd0b4599e62312fc786bb0bb2c0e8ff636ff

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 8c34d2f02e25e0fa96e574cadb43a6f14bdefc77f84950991da6e3732489e164
MD5 9c55eac3f87938b1a559d2009db4fdf0
BLAKE2b-256 5b03c6a746edb32be53754bd077b790da313a85c2aff749cabfac8763090baef

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 854aa813a55d6031a6399b1bca09e4e7a79a80ec05faeea77fc6809d59deb3d5
MD5 1a5d54c19b2607649935b567879a34a0
BLAKE2b-256 8cbfda21bf2db92abc60c38d2a9adb3e4f1e4f9a5ff3b93465a7efc37cf98eae

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 1ec53f832bfa91abafecbf92b4259b466fb31438ab31e8291ade0fcf07de8fc2
MD5 f2f3ac688ea7e73f5c0a47721b2fe921
BLAKE2b-256 d2f68f2852ab8a04ae60891fab51e7da178d800087f02fbbde341051927186d8

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 81994795e1b4f868a6e73107af8cdf088d31357bae6f7abf26c42874eab16f43
MD5 671a1f89e62a9b54cb006a22d9c7edec
BLAKE2b-256 459bfbe9de3cc5eacf2fe63ab6aaff52e796b50778e71b19143961c3fcc49aba

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 7cacc5a33767bb2a03b6090eac556c301a1d961ac2949be13977bc3f20cc4e3c
MD5 b75eb3865e7e08e66b176be43034db7e
BLAKE2b-256 c2f6bb84b447d62a9c2c2d87e2ab8fd6a1530a3aeb0f000ad7612d953b699d20

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 1a90e1030d9c61de64045206c62721a36f892dcfc5bbbc119dfcd417c1ca60ca
MD5 3d3f965b2472edd98739ab7bf69b7db3
BLAKE2b-256 d4d68dd783e5611ea8ce78b03b50d5b1f01c28aecb48e9bdaeec06455f0699b6

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-none-win_amd64.whl
Algorithm Hash digest
SHA256 203ca081d25eb6e4bc72ea04d552e457079c5c6a3713715ece246f6ca02ca8d0
MD5 d67ae1aa98e3ecc85c8928938ce43f56
BLAKE2b-256 94103dee08e9fc6bf8bc7cb074f92d17b2f3674adb16cb7c3109c0fd57d3f077

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.0-cp39-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.9, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.0-cp39-none-win32.whl
Algorithm Hash digest
SHA256 3279c0c1d5fdea7d3499c582fed392fb0463d1046544ca010f53aeee5d2ce12c
MD5 edc4aaace69f672610e41e2cf739bee6
BLAKE2b-256 790b6a0ff8ce87f913a8d4990e2a0f47113a2123bee57a79475bac4a86e13fc9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 7fd08ed6c14aa285482d9e5f48c04de52bdbcecaca0d30465d7a36bbea6b14df
MD5 55ce1ae8802a84c6452afef874e4e1fc
BLAKE2b-256 4a920e1b6d3c622e8bbf918b3abc323b777c717f697ebbdae59bab25af54b552

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 a8fc72a7adc6fa12db38100c403d659bc01fbf6e57f2cc9219e75c4eb0ea313c
MD5 6add26ace45acd5e5e4875a28ba89c1d
BLAKE2b-256 bd694e779df06f616d074e0f1265ccaf5d3952aa011bad13b84e3b8a20d920f7

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 7a1566cabd4bf8f09d6c1fa7a3380a181801a495e7218289dbbd0929de471711
MD5 9a5ded024441a337a07f2bc1c615885e
BLAKE2b-256 78a3a2e441b5f71db65e4d66c0e71b3269da57614f7e09367d42c440b77bcd8e

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 fd5934048e60aedddf6c5b076d44ccb388702e1650e2eb7b325a1682d883fbf9
MD5 ff7adbbf852db4f92baf6d08fc97f808
BLAKE2b-256 41b4f494f8b4b3141364de0658c078af50311bf51aea7176fa497c4c04b9bf07

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 ca79ea6ddde5bb32f7ad1c51de1032829c531e76bbcae58fb3ed105a31faf021
MD5 ba438e267685ae8aea6f5aca59891781
BLAKE2b-256 6c0e60c13bc7f077caa95e3a85e5666b3589009bab9c23ea7bbc16465cb73697

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 879201b1c76b24dc70ce02fc42c3eeb7ff20c353ce0ee638be6449f7c80e73ba
MD5 d44fd75371b034e08146d519267b45a5
BLAKE2b-256 2dfb9a84568d83019974f9d45aa48dfbdd2005ca5e4acace5dbf759ba0002252

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 8ee14b41024bc05ea172fc2c87f66b60d7c5c636c3a52a09a25ec18e752e6dc7
MD5 c752d37d0d05e0b9d6e9577b2d8ab2c5
BLAKE2b-256 a43ad6800ff46bc7587734156c5fed38579338220941cb9cdaae178d4a6f10a2

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 5f6c9554bda64799b1d65052d834553bff9a6ef4a6c2114668e2ed8f1871a2a3
MD5 836180099ca0810a8eaad79a1dbcb532
BLAKE2b-256 f9ad7f2f03a13edc5074061310f63a01922760a956699cfd2e089f7c54b9eb13

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 90ceca6a06bb4b0048d0a51d0d47ef250d3cb37cc36b6b43334be8c02ac18b0f
MD5 d66665a079362d2937593a6538f2fb02
BLAKE2b-256 b918c43b543f35403473ff7f4b703cc2a6f234dfe6ca1d9cd46d5e853666a095

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 a58d0b34586f4c5229de5aa124cf76b9455f2e01dc5bd6ed018f6e3bb12572d3
MD5 3974ca1845d3c55628e63e06559c6470
BLAKE2b-256 89a39f668acc1c9d052ea4e2ebb188a8887ef413aa383ad0f2fdd1739b835e90

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-none-win_amd64.whl
Algorithm Hash digest
SHA256 bf7f540ab8a6fc53fb762963edb7539b11f00af8f70b206f0a6d1a25109ad307
MD5 ef025d06e5bec6ed101e012971a921d6
BLAKE2b-256 1ab3257c747399f2b411e09e35aae495eff1ee4652ffc8edd4ebf4b9a9e87b99

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.0-cp38-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.8, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.0-cp38-none-win32.whl
Algorithm Hash digest
SHA256 93cc2ec19b6ff6149b2e5127ceda3117cc187dd38556a1ed93baba13dffda069
MD5 fee95d321cbafe9d219fbd5ff20dc714
BLAKE2b-256 e7692b6f6f883b77111a0bb312c35a532df2e3cc6420f473f84750681d661e97

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 397a24feff284d39b40fdd61c1c828bb6648dfe97b6766c84fbaf7256e272d09
MD5 ac5ea36df20b93c6258c111ebc431d65
BLAKE2b-256 f62f66fb6ec18c1250e00082671d077c5390c2ab496ff2789d401995b10719fa

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 a9aef7a5622648b70f979e96cbc2f795eba5b28987dd62f4dbf8f1eac6d64a1a
MD5 431473a73b8052bc0b21a55fdeab0782
BLAKE2b-256 aad01ed5308dfeb27150d94c60084594c91cca8f2e27eee120a0d18fc5f20fa9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ce4b177422af79a77c46bb8f56d73827e688fdc092878cff54e24f5c07a908db
MD5 a2b419ad8edaf9787663c46a0e39a8d0
BLAKE2b-256 5915c60dae8646210e148e8432fbb5a13d1f6fa8cefda6314ff6c4fc0b58b6ec

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 66daf7c6375a95970e86cb3febc48becfeec4e38b2e0195218d348d3bb86593b
MD5 4397cbbe19a98ef89ca429f5d4470749
BLAKE2b-256 1f98f992fe2a056087da340feae29837c267151fc6e75932ddda3150f3e9caa9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 fe799fa48fd7dd549a68abb7bee32dd3721f50210ad2e3e55058080158c72c25
MD5 e549e958b805488920ce98bccd1b9699
BLAKE2b-256 3648d86c0fdaf695158f1c31af1071be6fb64f2baea21fde92932b8f432702c3

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 0cbeb5406be31f7605d032bb261f2e728da8ac1f4f196c003bc640279ceb0f52
MD5 5df37eaf55004d2d2872bc66512aa14e
BLAKE2b-256 6bdbf5edd2719d78f4a5a90db9bd5302479252bc8ac608c06d5c88de966a7f74

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 98c4bd09b47f77f41785488971543de63db82608f0dc0bc6646c876b5ca44d1f
MD5 bf0de78f2f7d6748179aa195d5a1f081
BLAKE2b-256 378633b1ab8c8369c45d6e9c9b09cd1e025b7afcf7cdf49277c9274db5809cf0

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 97e87eb7cbeff63c3b1aa770fdcf18ea4f1c852bfb75d0c913e71b8924a99d61
MD5 17a44103a910330c11ad8df322afce8c
BLAKE2b-256 283456969fec74f59ba072851fc73c51124c619fd5d2bd0226ae51e80f84edea

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 9c2ec661d0d63e618cb145ad15ddb6a81e16d9deb7a203f385d78141da028984
MD5 137f28cf3a84bd89825dc39c1e28c4eb
BLAKE2b-256 4374047b53ff340fb08b8de55f5d07f1957260399b734072d8710d1d03279cef

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 f483af09a07fcb8b8b4cd07ac1be9f58bb739704ef9156e955531299ab17ec75
MD5 95a8ad3de619fc598a071798851dadec
BLAKE2b-256 a9112f680bfa869589f01dc7c48057eb52567fd169ca29d22253cf64ceee14d5

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-none-win_amd64.whl
Algorithm Hash digest
SHA256 2839369a9eb948905612f5d8e70453267d9c7bf17573e5ab49c2f28368fd635d
MD5 7f119a0c11574cfcf415d0d1e0974eb1
BLAKE2b-256 bff47ed4829ddf799843e183da6a5af19a6b8604b7d9c4245d47417ddcab932b

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.14.0-cp37-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.7, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.14.0-cp37-none-win32.whl
Algorithm Hash digest
SHA256 ae0d5b5ab6032c24a2e74cc15f65b6510070926671129e922aa3826c834558d7
MD5 4b925694829e99f6daf7669f0992d7f9
BLAKE2b-256 1e10d80e4c8a17adcd7d7c77791818c29d5adc22a596ec8613516268d319ea24

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 ae4fa13a786fd0d6549da241c6a1077f9b6320a7120d922ccc201ad1d4feea8f
MD5 34b9e055ba6a06e38e7ac44c4fb39e89
BLAKE2b-256 077b52e3a572e7e3330ccb3c0125383424cf5e70858448dc632c925d66eab9c9

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 aaa0401a245d891b3b2ba9cf027dc65ca07627e11fe3ce597644add7d07064f8
MD5 77801fb188d0e9d7b67a9d67bfbc71fc
BLAKE2b-256 ff9c64df579d086b5d71b8fd1165e7694c7122aa7471ae808ec1f02f7149b72f

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 495dc7d3b78815de79dafe7abce048a76154dadb0ffc7f09b7247738557e5cef
MD5 ce64ee3ed5d1f720c5330c60d494a116
BLAKE2b-256 e589d1c71025fc9ab2e7ceff88825dedb70f403c48298aef9fbc8736f5b15219

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 6ab1a58c05a3bd8ece95eb5d1bc909b3fb11acbd3ff514e3cbd1669e3ed28f5b
MD5 3c8dfbe851dc763156ae7a023b264b06
BLAKE2b-256 2f9a23594223de4b757c20621d2d1fc0b91eab98a334d4bc1078d4021f930332

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 08ea1f612796e438c9a7e2ad86ab3c1c05c8fe0fad32fcab152c69a3a1a90a86
MD5 f863d94d1f46ec0774642ffbc19832b4
BLAKE2b-256 215e5fcb407f689be514afe4c89e63865826ec20d8fe1c117cc22b45ff14505c

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 8b6e2d4bc223dc6a99efbe9266242f1ac03eb0bef0104e6cef9f9512dd5c816b
MD5 91c6fb2f018572ca893e9a35a8d351af
BLAKE2b-256 86dbd703da702638eb5ca558234ae7c33fa402be94f1231eb4eea340e829ba6c

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 d06a6fe406df1e616f9e649522683411c6c345ddaaaad7e50bbb60a2cb27e04d
MD5 91e2d76e08909906bc437d017e0c8ac9
BLAKE2b-256 8144f4949c4862f3efd2017583043072346a63f9aa6821d7bbfb3b00f35250d3

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 0e1818f33ac901d5d63830cb6a69a707819f4d958ae5ecb955d8a5ad823a2e44
MD5 0178810bc22ea3732f41537620dae6f3
BLAKE2b-256 17543b8d713dcb0e03929738fbe016bf6214bc40ad3bb63a2b74e537e5b5405d

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 5892ba10fe0a477bde80b9f06bce05cb9d83c15a4676dcae5cbe6510f4524bfc
MD5 e339f231ab8c29776483cc5dd7c27206
BLAKE2b-256 14cc93d20811308d05c19ef39c8c66224c11e1e9ea839e806fd64a3523d62f66

See more details on using hashes here.

File details

Details for the file tokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 e2c1b4707344d3fbfce35d76802c2429ca54e30a5ecb05b3502c1e546039a3bb
MD5 4c29bcb739dce5ba4050d27f8ac4f787
BLAKE2b-256 c96d6ab075ef5a42983ff3d8bdde81fa087f1a339b48895971a702b26c618cf3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page