No project description provided

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Anthony MOI <m.anthony.moi@gmail.com>
  • Tags NLP, tokenizer, BPE, transformer, deep learning
  • Requires: Python >=3.7
  • Provides-Extra: testing, docs, dev
Classifiers

Project description



Build GitHub


Tokenizers

Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Bindings over the Rust implementation. If you are interested in the High-level design, you can go check it there.

Otherwise, let's dive in!

Main features:

  • Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3 most common BPE versions).
  • Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes less than 20 seconds to tokenize a GB of text on a server's CPU.
  • Easy to use, but also extremely versatile.
  • Designed for research and production.
  • Normalization comes with alignments tracking. It's always possible to get the part of the original sentence that corresponds to a given token.
  • Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.

Installation

With pip:

pip install tokenizers

From sources:

To use this method, you need to have the Rust installed:

# Install with:
curl https://sh.rustup.rs -sSf | sh -s -- -y
export PATH="$HOME/.cargo/bin:$PATH"

Once Rust is installed, you can compile doing the following

git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python

# Create a virtual env (you can use yours as well)
python -m venv .env
source .env/bin/activate

# Install `tokenizers` in the current virtual env
pip install -e .

Load a pretrained tokenizer from the Hub

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_pretrained("bert-base-cased")

Using the provided Tokenizers

We provide some pre-build tokenizers to cover the most common cases. You can easily load one of these using some vocab.json and merges.txt files:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
vocab = "./path/to/vocab.json"
merges = "./path/to/merges.txt"
tokenizer = CharBPETokenizer(vocab, merges)

# And then encode:
encoded = tokenizer.encode("I can feel the magic, can you?")
print(encoded.ids)
print(encoded.tokens)

And you can train them just as simply:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
tokenizer = CharBPETokenizer()

# Then train it!
tokenizer.train([ "./path/to/files/1.txt", "./path/to/files/2.txt" ])

# Now, let's use it:
encoded = tokenizer.encode("I can feel the magic, can you?")

# And finally save it somewhere
tokenizer.save("./path/to/directory/my-bpe.tokenizer.json")

Provided Tokenizers

  • CharBPETokenizer: The original BPE
  • ByteLevelBPETokenizer: The byte level version of the BPE
  • SentencePieceBPETokenizer: A BPE implementation compatible with the one used by SentencePiece
  • BertWordPieceTokenizer: The famous Bert tokenizer, using WordPiece

All of these can be used and trained as explained above!

Build your own

Whenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer, by putting all the different parts you need together. You can check how we implemented the provided tokenizers and adapt them easily to your own needs.

Building a byte-level BPE

Here is an example showing how to build your own byte-level BPE by putting all the different pieces together, and then saving it to a single file:

from tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors

# Initialize a tokenizer
tokenizer = Tokenizer(models.BPE())

# Customize pre-tokenization and decoding
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.ByteLevel(trim_offsets=True)

# And then train
trainer = trainers.BpeTrainer(
    vocab_size=20000,
    min_frequency=2,
    initial_alphabet=pre_tokenizers.ByteLevel.alphabet()
)
tokenizer.train([
    "./path/to/dataset/1.txt",
    "./path/to/dataset/2.txt",
    "./path/to/dataset/3.txt"
], trainer=trainer)

# And Save it
tokenizer.save("byte-level-bpe.tokenizer.json", pretty=True)

Now, when you want to use this tokenizer, this is as simple as:

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_file("byte-level-bpe.tokenizer.json")

encoded = tokenizer.encode("I can feel the magic, can you?")

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Anthony MOI <m.anthony.moi@gmail.com>
  • Tags NLP, tokenizer, BPE, transformer, deep learning
  • Requires: Python >=3.7
  • Provides-Extra: testing, docs, dev
Classifiers

Release history Release notifications | RSS feed

0.20.3

0.20.3rc0 pre-release

This version

0.20.2

0.20.1

0.20.1rc1 pre-release

0.20.0

0.20.0rc1 pre-release

0.19.1

0.19.0

0.15.2

0.15.2rc1 pre-release

0.15.1

0.15.0

0.14.1

0.14.0

0.13.3

0.13.2

0.13.1

0.13.0

0.12.1

0.12.0 yanked

Reason this release was yanked:

Breaking change with unexpected effect

0.11.6

0.11.5

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.3

0.10.2

0.10.1

0.10.1rc1 pre-release

0.10.0

0.10.0rc1 pre-release

0.9.4

0.9.3

0.9.2

0.9.1

0.9.0

0.9.0rc2 pre-release

0.9.0rc1 pre-release

0.9.0.dev4 pre-release

0.9.0.dev3 pre-release

0.9.0.dev2 pre-release

0.9.0.dev1 pre-release

0.9.0.dev0 pre-release

0.8.1

0.8.1rc2 pre-release

0.8.1rc1 pre-release

0.8.0

0.8.0rc4 pre-release

0.8.0rc3 pre-release

0.8.0rc2 pre-release

0.8.0rc1 pre-release

0.8.0.dev2 pre-release

0.8.0.dev1 pre-release

0.8.0.dev0 pre-release

0.7.0

0.7.0rc7 pre-release

0.7.0rc6 pre-release

0.7.0rc5 pre-release

0.7.0rc4 pre-release

0.7.0rc3 pre-release

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.5.2

0.5.1

0.5.0

0.4.2

0.4.1

0.4.0

0.3.0

0.2.1

0.2.0

0.1.1

0.1.0

0.0.13

0.0.12

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenizers-0.20.2.tar.gz (354.8 kB view details)

Uploaded Source

Built Distributions

tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ i686

tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded PyPy macOS 10.12+ x86-64

tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ i686

tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded PyPy macOS 10.12+ x86-64

tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ i686

tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded PyPy macOS 10.12+ x86-64

tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ i686

tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded PyPy macOS 10.12+ x86-64

tokenizers-0.20.2-cp313-none-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.13 Windows x86-64

tokenizers-0.20.2-cp313-none-win32.whl (2.2 MB view details)

Uploaded CPython 3.13 Windows x86

tokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded CPython 3.13 musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded CPython 3.13 musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.13 manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl (3.4 MB view details)

Uploaded CPython 3.13 manylinux: glibc 2.17+ s390x

tokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.1 MB view details)

Uploaded CPython 3.13 manylinux: glibc 2.17+ ppc64le

tokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded CPython 3.13 manylinux: glibc 2.17+ i686

tokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (2.8 MB view details)

Uploaded CPython 3.13 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded CPython 3.13 manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.13 macOS 11.0+ ARM64

tokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.13 macOS 10.12+ x86-64

tokenizers-0.20.2-cp312-none-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.12 Windows x86-64

tokenizers-0.20.2-cp312-none-win32.whl (2.2 MB view details)

Uploaded CPython 3.12 Windows x86

tokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl (3.4 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ s390x

tokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.1 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ppc64le

tokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ i686

tokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (2.8 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

tokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.12 macOS 10.12+ x86-64

tokenizers-0.20.2-cp311-none-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.11 Windows x86-64

tokenizers-0.20.2-cp311-none-win32.whl (2.2 MB view details)

Uploaded CPython 3.11 Windows x86

tokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl (3.4 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ s390x

tokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.1 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ppc64le

tokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ i686

tokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (2.8 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

tokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11 macOS 10.12+ x86-64

tokenizers-0.20.2-cp310-none-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.10 Windows x86-64

tokenizers-0.20.2-cp310-none-win32.whl (2.2 MB view details)

Uploaded CPython 3.10 Windows x86

tokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl (3.4 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ s390x

tokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.1 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ppc64le

tokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ i686

tokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (2.8 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.10 macOS 10.12+ x86-64

tokenizers-0.20.2-cp39-none-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.9 Windows x86-64

tokenizers-0.20.2-cp39-none-win32.whl (2.2 MB view details)

Uploaded CPython 3.9 Windows x86

tokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl (3.4 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ s390x

tokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.1 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ppc64le

tokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ i686

tokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (2.8 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

tokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.9 macOS 10.12+ x86-64

tokenizers-0.20.2-cp38-none-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.8 Windows x86-64

tokenizers-0.20.2-cp38-none-win32.whl (2.2 MB view details)

Uploaded CPython 3.8 Windows x86

tokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl (3.4 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ s390x

tokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.1 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ppc64le

tokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ i686

tokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (2.8 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.8 macOS 11.0+ ARM64

tokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.8 macOS 10.12+ x86-64

tokenizers-0.20.2-cp37-none-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.7 Windows x86-64

tokenizers-0.20.2-cp37-none-win32.whl (2.2 MB view details)

Uploaded CPython 3.7 Windows x86

tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whl (9.3 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ x86-64

tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whl (9.0 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ ARM64

tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl (3.4 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ s390x

tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.1 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ppc64le

tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl (3.1 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ i686

tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (2.8 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARMv7l

tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

tokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.7m macOS 11.0+ ARM64

tokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.7m macOS 10.12+ x86-64

File details

Details for the file tokenizers-0.20.2.tar.gz.

File metadata

  • Download URL: tokenizers-0.20.2.tar.gz
  • Upload date:
  • Size: 354.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2.tar.gz
Algorithm Hash digest
SHA256 05c95c59b200c2fcf9b2da2d17df9236fb7a6df4136cfb251dfaa8803c0127fd
MD5 962ebdbdd41735cb2a157c06ba938bcf
BLAKE2b-256 9a6e4368d065ab4ab9157a28412df7106f1b2cb7448895059d9f5b6f965689f6

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 39b469c53d01d4b01b5f9031f2a37c2f686ccded1e5237a326aa9fedf9cb92b8
MD5 b5657513e1eb38fbdc5de028669b8056
BLAKE2b-256 6aae5fb1c3c5c7574e4bb9db271b83d571a279ee8fcddd9a6ac65c318355d362

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 7b5485d33b234ed042b2d3da24edb6f2ad0e8d796a747cdf0af28daf2d57b436
MD5 75bec99067e556b4020ac86ff57a0d87
BLAKE2b-256 bc8bb0ae25dae61b1d9c4518b6a894fa3c8a18f6cb7bd12bd2c4602406ec7c1f

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 258fb8a23c548192ab117b2286a199ef93bed186b338b5700f4d7f20b6aa36f6
MD5 00a03dbba9cc10cd0f6df78dd9c063eb
BLAKE2b-256 3062f84df4f7e8f2e5d966ba9bc046d5fe305644b4973aefcb9c56806baaa425

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 625137be04e38208aea6a8b6e458e0ece8d5e96f608f8bcad703f47b4ab72868
MD5 b414492f79a175e1280caa9d0ed86816
BLAKE2b-256 a00f2644edd880ba1de0f1376e993219b9f7b1af972e36527dbd942dbb96b6bf

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 602ded63e106066969d04ce614c6ad25d432e28ebb16543e7876b30e33cccc5b
MD5 b00e7d9f325384d6f857bb9f63635bb7
BLAKE2b-256 960b88030eb8f39002d5597d594382beaf51d86fad9ef639518811143864a229

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 97b1e631945cb505407c7cc7b6c34518a6fd82e20c5f6c7d54cba325b7eeba6e
MD5 2134c510c0ba379db5c39952fd53406b
BLAKE2b-256 eb184a0870402a5984ae26296fef596e5049041cba445b84058165082e757403

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 8c26f5d1bda22dc91c41a6d708e03ded5ee60975d2dda87f79651c74cb2b8829
MD5 b5a41f1faa04c36450d1c80ec41af9bd
BLAKE2b-256 2147220647bfe26a39697747889998e549c0818371f5c8dccd81c88e7d88d5d5

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 efaa29e985e2a9eff6a8fb2d454ba23dfd82324f04a76e8e193673261fc54ffe
MD5 746ae1f9844bf81f7eccd98d84dd96ac
BLAKE2b-256 4ac1fb7c303ae7ecab336c299c2c82667ce8e30606b55fe1ed9e6e144c96dbdf

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 0e0d0b6814a2285323fe669d2da5614fdb999b4b5d963d964f6fc8092065447d
MD5 6cd9363011bb73d81cbacdc607490415
BLAKE2b-256 d8d2781b0ae806bd58d4c102b857944cc8f06bdc5d2d45a284b73199ac2eee65

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 efbef80ef87459fffe3c615ba393b185ebe1e3069083b7619549d3d22dd08ba2
MD5 f3d288cc63df0a466dade5c8b9484f67
BLAKE2b-256 da0206ba0cac76a47fd2338ef65af9d35ee322001b8431d7a48e5d844c3e7fa3

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 cdefc3e44ff71e36b116d6b152344666212a07b91129ce41b667687869a7a3f4
MD5 38a4833398f0a03e67c32cfd2a7307df
BLAKE2b-256 b93fdc62ffcc0d877c6839629cd36841838cdcd4f4623aacdd7f756eddd8678a

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 0912a257b67053d070f9dd539befbcf0f9e6d86f456d099f7c30750dad6985ac
MD5 bc8d549f21623fc45226b531c38b83a0
BLAKE2b-256 db37bad383b7f92221e3394eda9856c6cd07403b8e312501ec74dad672e20bcd

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6ca7781d98858825ebe84d2ce692b1c4de5ec45733d30dd3a9398e804e79c8ae
MD5 668c7465c528c250ede6d43beec145fe
BLAKE2b-256 209087ae7498fa627a3dcfba04bbc77339ca621c2518ac3a71f508fc38040f81

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 477eaca81c233612f0a4eba2f90c1eb584ed6cb845f1f48e1a4374220dae6891
MD5 288436382744804031bc537b8f202b0d
BLAKE2b-256 39a8d1257272d556038d4f299c302be28892939bf8854f9d77cef26d93165567

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 bf69a9f201ccd8409f1ab265899ac64ec672ac9148bd048f365ed5b39758a697
MD5 0228c07e3508fd033968bc7d60156884
BLAKE2b-256 a51c4553481a1320235c25fb589efa670b8e61207c4f60a12776dc31223d4f83

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 6b7d6584b73fbc54cb93e960acc504f9a02b8cd3e9fcf664f5ed9213b4ea5a32
MD5 e8c9f49fe798c0bc9fd314c204aa47de
BLAKE2b-256 e5358004f925297548ca25b3109aeeea77f4f9ca1f9b6403d491aed0df04af21

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 300b6c814ec0e2ee086861632a9c4bfc9c6497aa8521be93e421deb3e35b6516
MD5 403842be13295d89446cbfa6762abb86
BLAKE2b-256 e33af60ad3601c9cf3748cee2a0909b86b8b77a033d30ccc35bed0aa152d22d6

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 c89ac11bb920e5cac941537aded586b2ea70e1e34de2c8b8c08c87bdc143f8af
MD5 a700e31f154bb62a538209101ca966dc
BLAKE2b-256 6b7be065141bd3806253bbde00b68264ba625b0066388c8c97699d8642aab4d8

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 2b19540a4a478df61270a55af4b78d2ef995f751d2ec07dee72aadb93c23e249
MD5 6f93387092575d4b44e3ad3d31874b2a
BLAKE2b-256 e2f52399f0f153e1bfca23b14d72545a2d0ff7cac64dacd198d880c54df31e5d

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 7438d992e9816b52e1e60967bea71fe03f6966a7e5946358cec6b43fb6588df9
MD5 ac09206881b4ab183a95f4da9dadc470
BLAKE2b-256 f5974ffd6f0d431807554d3806dcdf2ce1be5b98194d09268ca260a814db7a90

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 85b19ceb27994a03db4d13e568eb70e50354b3d3d364c95ba44fb5d56ca37d8a
MD5 ae5a94ce1ce0471e9f258a1e6caccd05
BLAKE2b-256 790c48405916a3f96abccf2052cf424ddbe921760ab4f496c866b78d45b133dc

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 4bc6acea6d541614c42f9a689aef63a765c12aeccecf4fc34d8606c41d66cdbf
MD5 9c9c7e85a1b02d5f7a5acfa8837b7e9f
BLAKE2b-256 e4f4f1f49bb6242c41113af47db83ce33a52a9af23daf7671ef79eea4f8e4b89

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 b7ac0e0075de89be1310cd30d13e6587af8c3a0f951096fe4f079fece4cba7a9
MD5 78c71369580d56f669e5bad9509395e3
BLAKE2b-256 1ed99a638b8d78f4b2b104ec6bdd36314463db8dcb8e346e06707c574d784d85

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 0c3e02f718163947da345bf52a4396f037d7b773118a0d03ed9e87e1a26c100d
MD5 9863edeccca74962acc3b3a7be129520
BLAKE2b-256 f1a0b85bfc7c5d230dc007a4469d5462615f23fb0a29e3f867f01072135783a9

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 a5ac72c3fb1387a1c2ed77a755c1b2c5188e0e995620051aec987540c5ae0e2b
MD5 30214aa1efda68c34056aeeba6a8bd72
BLAKE2b-256 8341d3e5227ced454ed56c0a53811cd90233c2160a6c23d5fc5e6f751534402d

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 69edc940db9510790d8642c7ca3fe40d4b6645ded943f8d7641ee77d4926534a
MD5 218509832129255dcb13aebc52c326da
BLAKE2b-256 714e858de1f8d6b6308a9e3d9d9c847aa5ea6942830bb15da4e06c408489de9e

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 4498d7e06123521d7fba85fc8cb9509591ed2f6fd8cb57fa238eebb420d11a1f
MD5 7171714c370587364b0b0a7ff9915888
BLAKE2b-256 12e2183b927b0c0dd7e986d4788c52b2cc0867da88f5962d910b978be21d82ca

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-none-win_amd64.whl
Algorithm Hash digest
SHA256 ee4a89d33a39bfa9e24a7bd74df3cafcd23f45142e51ea0226cf4f63f7292854
MD5 6f0ab20f5d1ba164ab9f0310748ee312
BLAKE2b-256 47b08fccf62667d7238cb3e3ee05246787f3b7317892ef58b17628a8983a9d94

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.20.2-cp313-none-win32.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.13, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2-cp313-none-win32.whl
Algorithm Hash digest
SHA256 68576b8cfaadcb43384ba70b98b12f566c50843a5ed1c48237c086ad6cfaa93a
MD5 435bf297bb1b66868e25363a2c05dd3d
BLAKE2b-256 2347b118a9fa93a69500466abb84d3a161b887a183177e0d18ee6a8f2300459b

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 ef33b0ffc41bfa6473103d16995e0a71b65a21b09f013f0872d119c251e95639
MD5 43ec2f4ed55f44233af8e464660892b9
BLAKE2b-256 3434841bc2a9e873d6addbabbe8437d3c92e7b7f3c398c2f911124cd1db18e57

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 ae4924d8596565470106b859be577734d75fdd2911d2dd266fcd7dbf4da7c193
MD5 21355020b638c7fcffd7d0a6fb695ffe
BLAKE2b-256 071d8bd0e13d092d2eb4fc83fdbfa3492459b0a4379aaab6e29aba1fa3f73838

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 eab036b5a5e36559d9e91cdc4a517badfdba6e91f1047485b9c8906810fd68a1
MD5 5e9b42d2d54bd02e8b0dcba2ddd3b082
BLAKE2b-256 ec7d68ab3210bccca803fd1c15f262f64448166f6a44775ea3b0641246dc20d3

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 4573bb25b93d359869a867bd9cfb5896a86b9c2b9a9ca81956c5dfe891667774
MD5 233abeeb272003690538b0d0d45c744c
BLAKE2b-256 26418f11f56e7e4ab1895f392a3ac65c559bad1c69a433b06359172c932e4805

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 02d450342011c18a8b5324ff97c42a325a10a1ce5ab097313fad829cbe89fcef
MD5 65ab950c1c943829fd3042668ddc006d
BLAKE2b-256 9892e7e06f7361197fa36598c326d85c21d75e814ea942c2a0e5e9a603dc125c

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 9a074fefd2874458dedafd450a7c74c075f0bf20f15172e8b6692c4aaab6e0dc
MD5 881eb7093249429bdf016fbeaf879d12
BLAKE2b-256 5c0e76b860c42cfce45ca6dc1458bacb31dfc78826b9c49f78b8faf515b832bc

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 f49a325322ec52aecda02847b9dc1fd190f9352e45ad16ff438fd7634ba6376d
MD5 033ecd6c67e947187b51b35bbe185358
BLAKE2b-256 c32ccc6e7bc4c2fd2e92a42c0f824c7eb9fcb6185d1c3b1c836216ecf4c978e1

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 c58cc2ca193018455618a27e165220f36aa83efe39e051cf976a5502a9a9b799
MD5 0d241d3dafb1c17373d592fc69298298
BLAKE2b-256 94a36c1096fc0780b5cc7a70bd5078ebc44ee2a64fc852f51858049dfc39532d

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 1ccef0ae85121b6c0d07e05cb77fe29842b29dd5b48abf0d340bfff8ce3f463b
MD5 4c77d924aa1b29155aa622505cc390cc
BLAKE2b-256 70ac937a046d1a9d756e37ddf83b38539f8c56ff71ce46b8a713c89cdd549a94

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 2643fee18919da76f498214e253ae7409a61f02823814d8a4486624d8a7b3706
MD5 121b80d2019957c8da2259c18e279430
BLAKE2b-256 db720f30cc2b397ac1a6dcc5c9c00ca5889af73d4e98078082bfe3d34fffb53b

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-none-win_amd64.whl
Algorithm Hash digest
SHA256 4dcce9e042e5b80e056beacd2e97a344316c29965e7f00b82f658ba08b9870cf
MD5 b8307f351313f05dc1a35703dfed8970
BLAKE2b-256 18be203a41a5d65ae982196b7d5984cf9a076374f4edee05cc57254db3979f78

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.20.2-cp312-none-win32.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.12, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2-cp312-none-win32.whl
Algorithm Hash digest
SHA256 f8d77aaefc4a4f23cfdedae2e28e5c99b301734ea57fc510de5c192408601b9b
MD5 6b5bf1565eec324e673c8417938c03a0
BLAKE2b-256 8614598e8310f4ffc61f32416c91627ec976e0194300d0ecf36eecc30a7b4464

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 3d1711852ba36a8944a76213543790e854d422e81b99ca678b4995d0d6accc44
MD5 16b3c8a36504d6d1f2f3a5ccd5cd1fb8
BLAKE2b-256 54ff71b92166744e5cb20cd57d318a0931626b86960f176d1bf3eca5cca5011a

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 1b8cf59f36c51a549a4d9c7b06d902bba5434c46ad2c8209e5512ac1e42ca348
MD5 726491e5e4d0366892fda12718533bb1
BLAKE2b-256 1bf43fa79b823cb6bfa8986dcd5a8baf709eeb5f30aa493b1f76f57c2ae6fb3d

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 6818ff76e51aa3bc7b358debffceaeb8b6827720083ceec026afadb3f44a9744
MD5 eef59d458113d098640e4479c9429e8c
BLAKE2b-256 ecac6b5d676438e850f74804644642dbeba338bd1b20cefedd4a2fc3bb8bc9e1

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 143b8015b2ece56cd31116bbffb96ba20d6bbb64407daed0fc8a146ec858045d
MD5 70fd0cb329893bba7f63f60a1c9d680e
BLAKE2b-256 7d73b24f6705eefb0ae0794a67b716271377275e8e02ce09f81043da049ad594

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 61383c265696215bfbf50175663076a8e4c3dc48a82022f86c26f9b2d9650b6e
MD5 36c44551b04a520c8ff75d5f34cc0100
BLAKE2b-256 15cf52bcc5cb7522f267960c2a466d95d8a0ced2188e3977ba3b15aa331aca7c

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 35a51898c0953f501b402e7219aec157a66e750349a9fbd35a337f8813654b33
MD5 21efb0127c4b3000e2cf0e514bae6182
BLAKE2b-256 d7c227646e0e21bc3470a604dbb870a23f70acc669aa666c26164627e046c59f

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 dc485a81f260d2673cfde202327c611b627c5da33ee363254767bf7a7618aa94
MD5 22114dbe049c828bdad9e70a1bbda18f
BLAKE2b-256 93a07909fda1421b7732d8230818e7cb6cb045bcc01135244c4c13f341e80df4

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 075d933b283e8aa07007f420e79876cf38f266dcecf617225b530aa17fb842f9
MD5 4e831df7febf0b4b8aa44877b076b0bc
BLAKE2b-256 c41083d577a97ba026975d33387b81bf95d10547a0dffec972badf6061aff64e

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 a90476820f64dc0e7fe9469eebf4dcdaa2bebebbe8f9b69bc74cbd9b08256427
MD5 984fe61a33c0654186ce599987e09091
BLAKE2b-256 4abef0691a2a95635f87d8c623247862beeba59798979cb8673922e72101839d

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 ae574dd21ddef77163e9bdf65b0d61d41eb435a11ae545c92d1bb1d2aebfd9eb
MD5 a9ac502fd14e5fc3a396abca5d3e3edf
BLAKE2b-256 2a8ff10b70d8cc76d44d313e56735774add1f41a82d50a0f6d6bf3d06ffa6607

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-none-win_amd64.whl
Algorithm Hash digest
SHA256 0427b592f9be8a8377602fa8996508c4d5fed6aa07971f4a866ef21ed6137dea
MD5 90677b7dd569a1ac16c52f8f7dec487a
BLAKE2b-256 a46403ee288a2243e24a14891c969ab85de2593c938f72d0ae8083bdfefd150e

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.20.2-cp311-none-win32.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.11, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2-cp311-none-win32.whl
Algorithm Hash digest
SHA256 a12ddc02cd8db6c3f6a66faf1e23e065f6ec50a1ff93077cc0ee526a60225cc0
MD5 d03cd83e5920a66ccd5ed9326e15c2bb
BLAKE2b-256 8900379ba1dfb40e4eaed40cfbaa9a598c42a65db2c8da85b53e9171c52b0be0

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 04d4010d3e5fb0c4c98060fb6ecbe42ca67a91b4eab2ddda2749b8ec18ac952c
MD5 facd9e8db20680f2c88ad502b0b39753
BLAKE2b-256 6c653bd23450a5b4c86ea055c1c66d10a61112c86631e0f712c14c32bd51febb

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 625ac108243a714bb8d099927d3723b01a03b258ef44af04c6d65620d19c9527
MD5 61f97e7e8d95443f0a9aa445ebbb82c0
BLAKE2b-256 4106604f3daf944e1a714987e606937b70450b3572bbc5f4fd25d6ee308f67a4

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 bd8dea683e84f795bb69ab822ef5b83921f22e6d9ef3ca7135ce35ba82d55249
MD5 91f54b9b84c182d30feb6567b7ee42e6
BLAKE2b-256 b877f26202ffa017be7d814b8c7dc561752092cf79b1a14995a1d87daca301ed

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 d95091c6f74f1c4f28a962d923442e492fe88ac3224c11daa999da438320eaa1
MD5 974e5aa8f01d5c37ca33335d32c64b8f
BLAKE2b-256 21e94b45c32728e3fc96f86a2e9be6bf9efee00c7a8c396c8c0343444b3e7eb3

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 43011f17b2544d9dfe3f1fd3e8acf9e6bec29147e7e166c405ecd4ae79994a7e
MD5 ae66c67347d2581ff86437325be29fd7
BLAKE2b-256 bcb25fe35ca4d8f54421b20a37c678626c92a44d7eb1f18b51c249c5ef39459c

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 19b888bece6ff5ed6834551f7043f4b55f0535b2911dcc655733f7009c177e4a
MD5 0f3ea9e59e33206888af8f34774afec9
BLAKE2b-256 be952790b2ca1fba797e7ea04929012d0ebeb45786c1eff0806f37c496d93ccd

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 0b91272d52e37367be87c06074db1e70f92ed4b997ad9a9422ad24bbeb50410c
MD5 e026b7e784694660c9f3c6fa615b45f8
BLAKE2b-256 468bf89585726af54f70bd483dac7758927f81f440d4c963fa9248c1b8360030

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 f57f4c0206048d561226879c04d43c78a360a919be305b9dc3e64c5e4103744b
MD5 b7446ab5db3b6100a3cccf302b42200a
BLAKE2b-256 2d13828aa9dab9657ac483ffe14be1b2747d8b564ccd660f34f235b86ace30b2

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 90808ce914e6aeea8d14db7119eedb591998493467c7b34929a9dc9b29ef5fab
MD5 d4b1871cb7e26cbb85467aa4df6ada6b
BLAKE2b-256 162d1ab522c7a9ebf2894dcabacea698eb7c667f5999ed4109c42602d4932918

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 b072bc2f125936ba6a86a4c8604696cd5bd1bb2dbd1fec4cce0f194f2dfad04d
MD5 fafdf5fe086cc400fe2b0719a2e064b6
BLAKE2b-256 4a45fe3664a7cdfad069160dcfa6678c95c2e8a204cef430194011070645e27b

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-none-win_amd64.whl
Algorithm Hash digest
SHA256 0f1da11ead494c62ab7da17a649f2ea2de468198bcf8e3b902ce7aaf8c6f42ce
MD5 273355b843df619e427d9e718b0096c6
BLAKE2b-256 af09ee7c5e54ba76bde477613c9df1fe5818ea410c69e237a088d6387fef080c

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.20.2-cp310-none-win32.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.10, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2-cp310-none-win32.whl
Algorithm Hash digest
SHA256 7b397bd0eb8dc871983669e2cb15b3913f7f23af3ea98dc07bd48cc11a8bdbe9
MD5 0b16289dd70f1e4753b4ffce591249aa
BLAKE2b-256 90dc8a2812bc52810a28e4ded850c3188b06f661905ad1372e6796b1d243ecb7

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 b52f19163f790870b4d9e4dfa0f7a4c75a372e0dffb80537efe652d6b3ab8c96
MD5 41bac918617bffacc4a0d24a92185a9d
BLAKE2b-256 a24a812aa45a06baade752093a924c1a73110c19603e92c3f68631225938c6e0

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 0dd4f1f0d2c141ad7c0736677b3d2e5437e5ecd1e73e3e1f3f24c12db83646a9
MD5 8b269ea71ecf260d053a6f49c65fefa3
BLAKE2b-256 ee1c922f702d1ae96f35c8db30927ff90e7694892f4e22d2e11301ca170eac2b

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 93cf8fb1dc7244b1595eecffbd018400c437c7e092e3075452b3e4225e90b1df
MD5 01b3ea89967a61fb01d9eebd0c1fac90
BLAKE2b-256 e4bbc24bf78f51629062868f47fee9ac53d592eed6ed4473b0f97602189bef2c

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 58defb199ce5708626e5dcafffd108c3b5eeb170d9a473382e40f7ea6362d786
MD5 cf5cf55d03528c8d0e67da739158ba3e
BLAKE2b-256 7c1d46b647703f354a58be1f982e0208548fe041488e8529ae3f44b1da7c0f73

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 858cf33522c6d8d4f35f28fca06e9ec735d577ed05881c6df9c51068b4c3abee
MD5 204e9d812966f17f88e3f30f473495db
BLAKE2b-256 aa3113910f8f87d54c94a41a896c4d99ee41ef4c0d5a8f23522ddd103c73a29e

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 cf7b25d1098130a73806037d4370f946ff8cbc68025e1e37c2122eecd199de22
MD5 abfc1fce3e0ae4c66ba15e8b8bad9ed4
BLAKE2b-256 f10563c3aa507499328e00ca4ab2a6966806b5ac4a3cd18b0654435aa05021c7

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 6b0d77497dc8f619a3cae519116c8d23c07fd3cf9cc62ca8dad6140f490aa282
MD5 93e142cecdfc98c55a36eae6edcd44ee
BLAKE2b-256 58e192c12746935ad99e4f760d4605b4a6bd67b73a7711f0b3fb34c34527fb29

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 12e87dd9eb607685423396b1c87f035658b6ea594c07a144378e2d63a10b90b5
MD5 565d5922b7fe511b19d59e33243a4b75
BLAKE2b-256 0b0e775eb6d9bd8a7f1a97ff480778e6383910a02da19c009486732b4bca8574

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 cd34334d90663bc7a6d6cb5fd4bc667687cd016e92b2624086ea03830221c489
MD5 44264e4a08b7505ad1a472c9aa30c86f
BLAKE2b-256 19fba4887001bf3be897e37f01a42295c08269e514a8579df9772dfe58aad3fc

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 dce8801285a2cd8eea906d8bede3c6a92bfc79a9a6bf164cc69940586e2aee97
MD5 0436d571a4452377b6edca0dfd4a3ef0
BLAKE2b-256 142bae0b948eacb0f3d15ac19a6e8a7cae2a173e33c1f6a3c4abcbab6e76ef97

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-none-win_amd64.whl
Algorithm Hash digest
SHA256 a6926bc2692f7ded544fed1a1596b7b22eee9590afc284696421e745b5bcb65d
MD5 f67934fce13a38172da606c82b043efc
BLAKE2b-256 3a0aa81c48732045398cc621c9f06ae884703c56017ee818d83aecb50bf8d759

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.20.2-cp39-none-win32.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.9, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2-cp39-none-win32.whl
Algorithm Hash digest
SHA256 1203e8d0adb0b36d2494c084a35ba8afa52e0735ce3e86aab033aec9e65164cd
MD5 fa5d4681006ca41f15098f27195e6270
BLAKE2b-256 7bbe654db960127285d010d063d34197a36f8f27a7981077a58b95a53ed8d0a0

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 e4c9656d1f985c274208ff9dcbe7c9c2bbb328457a27508f6044e468f6137c9a
MD5 26216f250495f49b162f3d688fa3a01c
BLAKE2b-256 ec32d400eabb3516ebe51aefe4931d52a43a1ba9dcd56ab2433908641c685250

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 eade373618be551b962d55818c978289eab58376073ceb4339554df1ef550d08
MD5 a03a10a8a8abf0e7798b1cc40e109d23
BLAKE2b-256 1ef076b0a0d6b048e6f5e7a33b08d7448e976c58b499f6d743462b36e0ce088d

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 1265baa0190729f83e5857fbee31842c96c4fc8a1ad7003e055c7560ad2885fe
MD5 e5394f32dd618c8c895598b3838ff790
BLAKE2b-256 1511663b52766ce0b5298b61ec7fe9d28cc1ec8871418ff75fdb9d2fec2d74b3

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 6b4c610a1b740539872257a76d3308ef1e84936a1cb11223268b8505ee023f23
MD5 f571b268f7bb8c83d9549eee4c0b5a89
BLAKE2b-256 250fcd28ccbc7a4daa2dd88b3bf29a3cf16994b9f8df0ac32b809d3a8bf45ac4

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 165c63342671df3c792ab3f4c5b763b2a5e73257e7faeab2767675929fe05853
MD5 b44c788b6f2b4cabfad1d7a267b9e1b2
BLAKE2b-256 2229603c8cdfabc5a7dbe27199b7f11fb8d2410427d3b42fd8498ae6aa8d4dd1

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 520c69ca7a6e108a6ca7ed8b5fd5e23eac37ca9bc0788892b41065184564337d
MD5 eedbbcf34da0a6b836f3f54da8525af1
BLAKE2b-256 d20f2089402d03779bac7ed24636c8d02ba0f63151d482b00796bb5ecfc66a8f

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 2e2404ffdf47b59e54c902055ff7e83b955a6bddaa1f09f4330c772d9b60f284
MD5 3e07cf19a85ab87195aaa9cc4744fa0a
BLAKE2b-256 89e3d37cd10ab74de64f0df88e241d632af80a3cfd9f528cedb49f1754b96132

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 2a4fe4d9c68e29274dde8b6ed56c83a12df8164f4f7a2a8c6edc20c5124aa65a
MD5 cb12811255908fa029cee4beb1ca9e82
BLAKE2b-256 7b581c4eb8e66f038dcc1412139b27f73a750ed9b1835725488bd055a7318f90

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 ad42cca87d7a8c69c3995d53d473e14c160fcdf9cedfe91092b458f2aa1d2c84
MD5 92c68c187d91b4e81e033ef050b5a071
BLAKE2b-256 aa5e380d0f809c1436dea9688f4cb99f8dbf9fe5e372c70b4a33bb1635d6c379

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 f2512fd654af3d8316524767b18c2548226b01fe6d79f559ef200d95488e8187
MD5 83bbf5fc366626f7cd8a410c3bb3fe4e
BLAKE2b-256 8707a172e2ecf6825ac6f639a0d0a1646ae3c702b88674045bd712de47562890

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-none-win_amd64.whl
Algorithm Hash digest
SHA256 871cac55ac333674254d476d75d22855aec6a16c4939a7d455317e447afda00c
MD5 ccee9289fd31640381c2b5825cd3b765
BLAKE2b-256 f3dc62f49c9dc1a51923a8ec516eb9d05212b978142e524a8a44913a8ed690dd

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.20.2-cp38-none-win32.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.8, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2-cp38-none-win32.whl
Algorithm Hash digest
SHA256 5b8c4afd7816d836ceeec990855f65b115e7a39dbbd26bdfa20b360a43b4d35e
MD5 f95bf95f33823911ff8d78669f9ed6cc
BLAKE2b-256 ac6cbc35873f2beb98e3c1ccaceddb42474e6c74a71f26a26bf33a513fbd57b0

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 97a2294588de369008337864a466e9637729445a7261c6ae3e9de9bcd4f17721
MD5 146f7782157374c114ec539444536ca6
BLAKE2b-256 942002b71f9844d1ca7eec7e441de13f9ff8ffd6fa39c2117b34d16b85307f67

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 2daec7c4b2b99a2d4cf1ce83616432dbb2480d784b6a3a5a28aabb8a91665378
MD5 486cfda4d5bb0f482feb0dc2c659540f
BLAKE2b-256 08efd2c0d7523e5c2268b7c661b742b22f74f6a1bba05f81e8c8a59a6afdc7c4

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 4cca5de082aa78850d6c2528abc9a076110bdbdd9873399c2c4bb4d3704574b0
MD5 9c22447e5bb339a03c927e4cbe28d3ab
BLAKE2b-256 48f377c2396a1627a22b9b67618b326d1c3a96a2499fc4606e98a1066df61173

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 4db2aa974374ce87aa7bfea3573a4d006e31c8d093be12bccd25f29e1551b245
MD5 930d3684ef4aa49c9b5a08b6dd9a467a
BLAKE2b-256 44a34f53f58505da786bd459d33a2ce69264428548fd31f6ce0458a9c7d3d0d4

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 6d9b0099662a1e555cf3c7341c54c831e7f4394c953b7d93bfe0786c3a9fe7fd
MD5 0f4c5f924981623415c6a056202a4140
BLAKE2b-256 f7dc3f449194a52ef477703f46432ef02be3aa114ba8be7c6bca677deff95b3a

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 23e023e89382d54f721c2bae19f37e5abef8d43739c0625d3a28f9c5b0565b13
MD5 91dcb669b7aaf273d5be8b6b9b99b673
BLAKE2b-256 c10463eb00cf9ebbf824b748fe0a5a3fe70133579eadb71e5ddce7f546f2e073

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 04b80dda85dc4ca2cc26c736490a116da02a48d54835d6f358496b12fe201fd5
MD5 ab4eae4b6f0197b70c907ba0361be8c9
BLAKE2b-256 a3e54564be827d0cc3968962059857dae2e04175e2b1ff600d1e553990efb82c

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 fa64548c61de8b7fccb53fcfa82935f77726bc6a50518dff88efa6e5fd56aae0
MD5 fd97d7c1ead88c2b1c5987bbf69d768e
BLAKE2b-256 ce5c37e43f5f9be831ddb28c3b84fd678a8e299ca2d4b2e92054b4606036274e

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 845107fb7da8fb3fab988bde10d323f70d46a2e8a4585aaadacf7e3a0cb6fd89
MD5 e7224c64899b5983c546d27db256231e
BLAKE2b-256 d20b41d11b987d734e4fb7e26169effa905360fc57a32a45e885ec5e099e54f7

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 43c00dba54b30736a444fb302d205e34fe079e2845d989f796f1b13295e7ef71
MD5 c98152f88b27147fa186e45761de4c80
BLAKE2b-256 353fa1c2036c931287f0d314b47ab2ba7287d6aa39a41b6e307e37311d9ea246

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-none-win_amd64.whl
Algorithm Hash digest
SHA256 340ad77d916590f07e0ea0a536a769c61c570c35893094268621eda7d7bc125d
MD5 1f2bb252dc241fc73adf02ce9fb19eea
BLAKE2b-256 91a3b2fc362218c5244069ee72423f95c695d897148bd1d9d60af536394bd273

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.20.2-cp37-none-win32.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.7, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for tokenizers-0.20.2-cp37-none-win32.whl
Algorithm Hash digest
SHA256 0cb864f0fcb59a82b27168a3e28dd47df6fef9449424b1c63af0c3239ef90d97
MD5 dbcaba8612acd6d61357bc78c68a4913
BLAKE2b-256 2e7c4fcf68503189a0c8ebe42b6ccd963a7f424261409c19a8952b90c4707728

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 b9ad4b4954b06d5a7f31cec1a2815bc02303de45d907b1d5372cb35f9bd26e88
MD5 9c256b672fb2f0c8f3502023a5b4dfd8
BLAKE2b-256 d425cde00d1b44b90140c800f2ab33232d7cae8d69de25ee23fc1342c3a0031f

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 d1d791190fd55b3c6243e888c7206830bdd0e0c3ef61a21fe9577d72406266bf
MD5 2576d620fc47c85bb0dbfaab9f478925
BLAKE2b-256 0c88c743d22410416b7c3edc7e8f2edfadf428040eb88303d3168e44808ab655

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 dd7bf1c8bc0f5103cf1f31988f63c46d30056b9d7a5191691c4cf9c7cd888bb6
MD5 e6c0c6867f3477e61ef330dc1cbd42d1
BLAKE2b-256 6a6eca079cc831d2d11f2ff8d9984d9fba110f6ad01d632db9b81d7380d598b7

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 9f8be47b38456376b4e067334ad09d2ec6142a34872b0f95e2a63a38d068d38a
MD5 a6ec7e2b536b62c3506238258171dc4e
BLAKE2b-256 01c5653f2d341dfc6f0479ac6bfee1aeea2891ae66d6ceea5c424bfb810b2aed

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 bc55370604ade0a8cca9bd2351489c39e13ae34210a2adfa3e78ddebaf0a4102
MD5 731b6024a07979c4d87ca36025ea2239
BLAKE2b-256 ace42316222ce80d6d0bb0f47e75104c2d1271e3527b2a9e99b900b56b8084ca

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 64d5bd597e1f64112c1c3c8c7058b6d35f95e7ef6dfacc80e00963527082f45e
MD5 22d82e094e7f02631405fee88b217dd7
BLAKE2b-256 d84bef6ad077dc3a7765bf80705389f1e658127985772400f06a3109b5dee216

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 ca9dd9291e126879bcbe35b95861b8152312d230a1a491d4026828aa6b58730f
MD5 9d694a183366778e6cc3624fcffacc0b
BLAKE2b-256 ac9be5c916be3735c1bba00b4dc6d5e2ccbf84b2b2d7441daf5ec8e8d4540d9b

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 2121bdf9461aa522e4e324d71cfcbb1a99cc8ec5aa817438ea0aac996b14d4b3
MD5 b4a70c67955d8362c1dd71a7b6664495
BLAKE2b-256 497ae97588c138b39e325df9837512063ed7140e2ece0033d5b3bf90cac8d0b7

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 dd4eafddbdc8ae2d01115d7731907b75f80110cb5dcabaab46facd19d881451a
MD5 8ebea895a706bffef8579fd78eb7c6f3
BLAKE2b-256 5e263dac32b1954793d2482687cdf2b1384a4493152a1e6322fee2faff8e4b56

See more details on using hashes here.

File details

Details for the file tokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 b33e077d00200c40248f69b437ab95959155fbf3e199bb70f24cc54b5e5b33d0
MD5 2964948b5c24b75c221071a348d0addf
BLAKE2b-256 208a201f9b7dc0e22ea4ac38be165c5031fc39ca0b7e867b10ff3f3ec8e22120

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page