No project description provided

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Project description



Build GitHub


Tokenizers

Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Bindings over the Rust implementation. If you are interested in the High-level design, you can go check it there.

Otherwise, let's dive in!

Main features:

  • Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3 most common BPE versions).
  • Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes less than 20 seconds to tokenize a GB of text on a server's CPU.
  • Easy to use, but also extremely versatile.
  • Designed for research and production.
  • Normalization comes with alignments tracking. It's always possible to get the part of the original sentence that corresponds to a given token.
  • Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.

Installation

With pip:

pip install tokenizers

From sources:

To use this method, you need to have the Rust installed:

# Install with:
curl https://sh.rustup.rs -sSf | sh -s -- -y
export PATH="$HOME/.cargo/bin:$PATH"

Once Rust is installed, you can compile doing the following

git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python

# Create a virtual env (you can use yours as well)
python -m venv .env
source .env/bin/activate

# Install `tokenizers` in the current virtual env
pip install -e .

Load a pretrained tokenizer from the Hub

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_pretrained("bert-base-cased")

Using the provided Tokenizers

We provide some pre-build tokenizers to cover the most common cases. You can easily load one of these using some vocab.json and merges.txt files:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
vocab = "./path/to/vocab.json"
merges = "./path/to/merges.txt"
tokenizer = CharBPETokenizer(vocab, merges)

# And then encode:
encoded = tokenizer.encode("I can feel the magic, can you?")
print(encoded.ids)
print(encoded.tokens)

And you can train them just as simply:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
tokenizer = CharBPETokenizer()

# Then train it!
tokenizer.train([ "./path/to/files/1.txt", "./path/to/files/2.txt" ])

# Now, let's use it:
encoded = tokenizer.encode("I can feel the magic, can you?")

# And finally save it somewhere
tokenizer.save("./path/to/directory/my-bpe.tokenizer.json")

Provided Tokenizers

  • CharBPETokenizer: The original BPE
  • ByteLevelBPETokenizer: The byte level version of the BPE
  • SentencePieceBPETokenizer: A BPE implementation compatible with the one used by SentencePiece
  • BertWordPieceTokenizer: The famous Bert tokenizer, using WordPiece

All of these can be used and trained as explained above!

Build your own

Whenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer, by putting all the different parts you need together. You can check how we implemented the provided tokenizers and adapt them easily to your own needs.

Building a byte-level BPE

Here is an example showing how to build your own byte-level BPE by putting all the different pieces together, and then saving it to a single file:

from tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors

# Initialize a tokenizer
tokenizer = Tokenizer(models.BPE())

# Customize pre-tokenization and decoding
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.ByteLevel(trim_offsets=True)

# And then train
trainer = trainers.BpeTrainer(
    vocab_size=20000,
    min_frequency=2,
    initial_alphabet=pre_tokenizers.ByteLevel.alphabet()
)
tokenizer.train([
    "./path/to/dataset/1.txt",
    "./path/to/dataset/2.txt",
    "./path/to/dataset/3.txt"
], trainer=trainer)

# And Save it
tokenizer.save("byte-level-bpe.tokenizer.json", pretty=True)

Now, when you want to use this tokenizer, this is as simple as:

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_file("byte-level-bpe.tokenizer.json")

encoded = tokenizer.encode("I can feel the magic, can you?")

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for McPotato from gravatar.com McPotato Avatar for Nicolas.Patry from gravatar.com Nicolas.Patry Avatar for xn1t0x from gravatar.com xn1t0x

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Release history Release notifications | RSS feed

0.20.3

0.20.3rc0 pre-release

0.20.2

0.20.1

0.20.1rc1 pre-release

0.20.0

0.20.0rc1 pre-release

0.19.1

0.19.0

0.15.2

0.15.2rc1 pre-release

0.15.1

This version

0.15.0

0.14.1

0.14.0

0.13.3

0.13.2

0.13.1

0.13.0

0.12.1

0.12.0 yanked

Reason this release was yanked:

Breaking change with unexpected effect

0.11.6

0.11.5

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.3

0.10.2

0.10.1

0.10.1rc1 pre-release

0.10.0

0.10.0rc1 pre-release

0.9.4

0.9.3

0.9.2

0.9.1

0.9.0

0.9.0rc2 pre-release

0.9.0rc1 pre-release

0.9.0.dev4 pre-release

0.9.0.dev3 pre-release

0.9.0.dev2 pre-release

0.9.0.dev1 pre-release

0.9.0.dev0 pre-release

0.8.1

0.8.1rc2 pre-release

0.8.1rc1 pre-release

0.8.0

0.8.0rc4 pre-release

0.8.0rc3 pre-release

0.8.0rc2 pre-release

0.8.0rc1 pre-release

0.8.0.dev2 pre-release

0.8.0.dev1 pre-release

0.8.0.dev0 pre-release

0.7.0

0.7.0rc7 pre-release

0.7.0rc6 pre-release

0.7.0rc5 pre-release

0.7.0rc4 pre-release

0.7.0rc3 pre-release

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.5.2

0.5.1

0.5.0

0.4.2

0.4.1

0.4.0

0.3.0

0.2.1

0.2.0

0.1.1

0.1.0

0.0.13

0.0.12

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenizers-0.15.0.tar.gz (318.5 kB view details)

Uploaded Source

Built Distributions

tokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded PyPy macOS 11.0+ ARM64

tokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded PyPy musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded PyPy musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded PyPy manylinux: glibc 2.12+ i686

tokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded PyPy macOS 10.7+ x86-64

tokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ s390x

tokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ppc64le

tokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.12+ i686

tokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

tokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.12 macOS 10.7+ x86-64

tokenizers-0.15.0-cp311-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.11 Windows x86-64

tokenizers-0.15.0-cp311-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.11 Windows x86

tokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ s390x

tokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ppc64le

tokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.12+ i686

tokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

tokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.11 macOS 10.7+ x86-64

tokenizers-0.15.0-cp310-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.10 Windows x86-64

tokenizers-0.15.0-cp310-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.10 Windows x86

tokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ s390x

tokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ppc64le

tokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.12+ i686

tokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.10 macOS 10.7+ x86-64

tokenizers-0.15.0-cp39-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.9 Windows x86-64

tokenizers-0.15.0-cp39-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.9 Windows x86

tokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.3 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ s390x

tokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ppc64le

tokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.12+ i686

tokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

tokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.9 macOS 10.7+ x86-64

tokenizers-0.15.0-cp38-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.8 Windows x86-64

tokenizers-0.15.0-cp38-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.8 Windows x86

tokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.8 musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.4 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ s390x

tokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ppc64le

tokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARMv7l

tokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.12+ i686

tokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.8 macOS 11.0+ ARM64

tokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.8 macOS 10.7+ x86-64

tokenizers-0.15.0-cp37-none-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.7 Windows x86-64

tokenizers-0.15.0-cp37-none-win32.whl (2.0 MB view details)

Uploaded CPython 3.7 Windows x86

tokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whl (10.2 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ x86-64

tokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whl (9.9 MB view details)

Uploaded CPython 3.7m musllinux: musl 1.1+ ARM64

tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl (4.4 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ s390x

tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (4.2 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ppc64le

tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.6 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARMv7l

tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

tokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl (3.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ i686

tokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.7m macOS 11.0+ ARM64

tokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.7m macOS 10.7+ x86-64

File details

Details for the file tokenizers-0.15.0.tar.gz.

File metadata

  • Download URL: tokenizers-0.15.0.tar.gz
  • Upload date:
  • Size: 318.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.15.0.tar.gz
Algorithm Hash digest
SHA256 10c7e6e7b4cabd757da59e93f5f8d1126291d16f8b54f28510825ef56a3e5d0e
MD5 6e36d493f213c066713789a1411e1467
BLAKE2b-256 9f171df113d77dab378cb02fcee438893610e055621d3994b51d5ffe315170e4

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 76f1bed992e396bf6f83e3df97b64ff47885e45e8365f8983afed8556a0bc51f
MD5 468a258278c595b7756808265d1d7946
BLAKE2b-256 afbd3c5d732123a531172f7b628d669a964fbd8478fb7579823a9227dd00d136

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 85ddae17570ec7e5bfaf51ffa78d044f444a8693e1316e1087ee6150596897ee
MD5 3bc516690c4ab1a6784e52909aa170f5
BLAKE2b-256 1f53dae73dfdc4c61096182f5078d7375035a35c7dbf0bc2a11d55e39b08f885

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 fac2719b1e9bc8e8e7f6599b99d0a8e24f33d023eb8ef644c0366a596f0aa926
MD5 17ddecc035992ab5619f4ce033ff8f12
BLAKE2b-256 06fa8b2fdde82297f9b529b7f6def48b196e8cdfb1e35feb7b63d322b193b091

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 3b22cd714706cc5b18992a232b023f736e539495f5cc61d2d28d176e55046f6c
MD5 0c829c6608e0f3bfe110f3703e963849
BLAKE2b-256 7ecb69f7c1ce28efc3cbd1361cd053af8059b8b7c16e21b55325c4054bcbb2af

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 ed56ddf0d54877bb9c6d885177db79b41576e61b5ef6defeb579dcb803c04ad5
MD5 2627e34517254da881c257da7c577191
BLAKE2b-256 4720d2686dd8424b0b0db88c36508a0d91deb8be0a0e3423165fd0e8213baa2c

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 d3125a6499226d4d48efc54f7498886b94c418e93a205b673bc59364eecf0804
MD5 8f437624ea2003881931b41590261535
BLAKE2b-256 5803ab4ebf2d20704fc6293a677f09a796b450143ccac79aa707f075bf6255b5

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 309445d10d442b7521b98083dc9f0b5df14eca69dbbfebeb98d781ee2cef5d30
MD5 cf3d1c0a0eb3db5fc558dacf71ed7edf
BLAKE2b-256 7272f690a9d927f505478402fe1264c606a377abef2acfebb0fbac7cbee577f0

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 fa8eb4584fc6cbe6a84d7a7864be3ed28e23e9fd2146aa8ef1814d579df91958
MD5 4e545af506aaeeabbac782543276a036
BLAKE2b-256 3c71996a3d6c76d13092faa51ef3aa2f8695b2831ae53829e822e22d34ff493e

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 a8da7533dbe66b88afd430c56a2f2ce1fd82e2681868f857da38eeb3191d7498
MD5 fec3cbf9b46d908d973b55bdf9204b7c
BLAKE2b-256 5dadd39107841995b681c6c083e5ce54228c846c9b5cf645206e6f5ca0371c42

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 65f80be77f6327a86d8fd35a4467adcfe6174c159b4ab52a1a8dd4c6f2d7d9e1
MD5 8e86c312e52f09010426dcc0d8f05857
BLAKE2b-256 8c3c23118713a43a5e9f1a36df3a17a9e95ad05267fde9a29a0da98b9ed48fba

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 d4fab75642aae4e604e729d6f78e0addb9d7e7d49e28c8f4d16b24da278e5263
MD5 d855df8db47a697c9fcadd91547183d7
BLAKE2b-256 a820e30598415b82e15ba897b019b1d199e528b68e42f94dcf54d7dd2965cffd

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 0a1a3c973e4dc97797fc19e9f11546c95278ffc55c4492acb742f69e035490bc
MD5 afc4ed2078d80667478dd966d7676dd5
BLAKE2b-256 6eac846cea8ac6b542b5de54ffd67e854511b54ab83d82a744a5e5b2be0f4b48

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 2a0dd641a72604486cd7302dd8f87a12c8a9b45e1755e47d2682733f097c1af5
MD5 6509082481bf314d693a04ba83ef9308
BLAKE2b-256 87011fba5379bef39abd7b45c483e8e77c2b80ac80af3f7537690540ddd4103c

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 8a765db05581c7d7e1280170f2888cda351760d196cc059c37ea96f121125799
MD5 251ca6e063c22e9b0654f3dfed195089
BLAKE2b-256 ca4a032185b97c9f51360942a8532f41deea7a3dec2a720c7731f794610e7b3e

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 7f17363141eb0c53752c89e10650b85ef059a52765d0802ba9613dbd2d21d425
MD5 c83de8eef517937da7316739885d59d9
BLAKE2b-256 57bd4334666aecbcf23fbc0f3fcaed64034cd38c96744d54e714f1bebe36b0fb

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 ca003fb5f3995ff5cf676db6681b8ea5d54d3b30bea36af1120e78ee1a4a4cdf
MD5 6a2fcb0db85c8dd61b2b181338a2bc73
BLAKE2b-256 6bb760a54bb9e8fdbbe218fd3607a5f60c9ebbd1b92878a82d48fac48e6c542e

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 c1e4664c5b797e093c19b794bbecc19d2367e782b4a577d8b7c1821db5dc150d
MD5 952e79721ed990d9ae3b02d24dd8d26f
BLAKE2b-256 f334d4082f792179f4209fb1e20df627f40fcbd3b38fcc1b1e8a1ad65e392ed5

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 1eef39a502fad3bf104b9e1906b4fb0cee20e44e755e51df9a98f8922c3bf6d4
MD5 86c0245b430b00cdac3150df85a75e97
BLAKE2b-256 460d11600564c528d0e669c9aeba4109c069117dd5018663919f6d87dbc60da3

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 f6456bec6c557d63d8ec0023758c32f589e1889ed03c055702e84ce275488bed
MD5 1f8327d39964ea83ccb322e965e4a026
BLAKE2b-256 7f3d6e5b742b55856c8d69fee603015770658b0125887a5a56afffd1cbf5c2f2

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8d7d6eea831ed435fdeeb9bcd26476226401d7309d115a710c65da4088841948
MD5 88655b737e74d39604e9df367010a653
BLAKE2b-256 c5e4e3b664f42f27f04d262d3645d3136be4ff62b2d46e4a4088588a47987bfa

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 160f9d1810f2c18fffa94aa98bf17632f6bd2dabc67fcb01a698ca80c37d52ee
MD5 cbb3e70e62f3f4c719c514eac3e269ce
BLAKE2b-256 39c336aaa702417398f4c1191b2aff08447b65963cf3f542d844f3aa6c08c3b0

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 82641ffb13a4da1293fcc9f437d457647e60ed0385a9216cd135953778b3f0a1
MD5 aebce6bfcfabecc1487ab4192243576b
BLAKE2b-256 4891d58433ab739968996f8011e224f58dab1a3419c87fc42dcd24837ea5364e

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 d801d1368188c74552cd779b1286e67cb9fd96f4c57a9f9a2a09b6def9e1ab37
MD5 4e2b79e0a08dd97c4a6f83c24273913b
BLAKE2b-256 36f1b2397cbaddede34376a27afeb8cb7bb361f09116df01fa1e4092f7c82715

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a40b73dc19d82c3e3ffb40abdaacca8fbc95eeb26c66b7f9f860aebc07a73998
MD5 5a8782f4093eabf5d571be72ed70a340
BLAKE2b-256 bf7b7f844c9c00306fce3ddfb0ff5438a8a9d19e8e9b458f3e3dca30b01126bc

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 78104f5d035c9991f92831fc0efe9e64a05d4032194f2a69f67aaa05a4d75bbb
MD5 75795a45a226ab9ce30c5ffddf39660c
BLAKE2b-256 a9b166eb9aba792cd6e9c87412f0f9c72f754cde6d4dd72c17fc23e1a09dc458

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 22c27672c27a059a5f39ff4e49feed8c7f2e1525577c8a7e3978bd428eb5869d
MD5 e75978caf1066c7eb81dc30ed7227d07
BLAKE2b-256 665bc16f4f2025ff0eb32a4e49404bcf2f756db11a26027645428ace5bf86ae1

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 3bb0f4df6dce41a1c7482087b60d18c372ef4463cb99aa8195100fcd41e0fd64
MD5 928fc0bf05992fdb69d6797bbe1afe81
BLAKE2b-256 6f2ca3fdf5d1c68e32b2dd1fcf370c418c887e51f1043377b01691cf92a9ebfe

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 77606994e793ca54ecf3a3619adc8a906a28ca223d9354b38df41cb8766a0ed6
MD5 d4101371fa346e81b2f3531250f42efc
BLAKE2b-256 5560bed932815d2e9a9d01d6b36127203f508c62cf8d10cc22f257a8d4cd77fc

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 9c91588a630adc88065e1c03ac6831e3e2112558869b9ebcb2b8afd8a14c944d
MD5 51c2bc1e8cdf054ab1f719b6ebcfaabf
BLAKE2b-256 8cad54fdcda8f9f45eff23d8d9d6fde14ee0971936c3dc4c20f7877f4d2e6ad2

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 3768829861e964c7a4556f5f23307fce6a23872c2ebf030eb9822dbbbf7e9b2a
MD5 7a1ac5807cb1194a235be5c25ac490d2
BLAKE2b-256 d3c3e8a788e6201acd142183a55009e4f78d375a453b6fd7d0babebbcd682dbc

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 babe42635b8a604c594bdc56d205755f73414fce17ba8479d142a963a6c25cbc
MD5 2b6dca1c066e2faf6761f2bbdb3307f3
BLAKE2b-256 bce66abf4df5c5cc528f4426cd8b5b48efab773b190788302889a82b9b81096d

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 10361e9c7864b22dd791ec5126327f6c9292fb1d23481d4895780688d5e298ac
MD5 73c90945b835b134d380ccbb431e649a
BLAKE2b-256 47930c9a5369e9312b87ce453addb60b3c6fedba0fffbe77449e3be48394ee22

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 d0ebf9430f901dbdc3dcb06b493ff24a3644c9f88c08e6a1d6d0ae2228b9b818
MD5 16d70aac40a5bccb33cce9d6a35a1002
BLAKE2b-256 5f9fbb5c45c81d2f40981c79f807d481bb389962b2329147523d69b51e8d2b8a

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 8413e994dd7d875ab13009127fc85633916c71213917daf64962bafd488f15dc
MD5 53fafbc2257c09d5643f9b39558d853c
BLAKE2b-256 0b9ab347b0460458cae2f27b8908fff56f43b75fc060562684da8a10808b9d1e

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 309cfcccfc7e502cb1f1de2c9c1c94680082a65bfd3a912d5a5b2c90c677eb60
MD5 df3f26cbb84d7128d81ab6c1778392cb
BLAKE2b-256 04b78baf38e478838ef5d1fa589740f466a91691109c45b609622411535c7f49

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 4a0a94bc3370e6f1cc8a07a8ae867ce13b7c1b4291432a773931a61f256d44ea
MD5 2c036693f6955b3889d2d557be09ab8b
BLAKE2b-256 983872b818a4f0d07c5d51706719b9223ee82dc327ac8c7931aeef2652f20ed3

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 c9cce6ee149a3d703f86877bc2a6d997e34874b2d5a2d7839e36b2273f31d3d9
MD5 263563f810f427a6eacca4085a820d40
BLAKE2b-256 26b1baf71a91c3b49007b32ee4c1447ff6e5df4b74b3fbe1c80232743e9248f9

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-none-win_amd64.whl
Algorithm Hash digest
SHA256 2dd681b53cf615e60a31a115a3fda3980e543d25ca183797f797a6c3600788a3
MD5 5a65ec956340e51b5f2c34840d652fd9
BLAKE2b-256 be5f2cc4f229bf85d90842f513be31a529595c10b8c8b8193c077230a8c17548

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.15.0-cp311-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.11, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.15.0-cp311-none-win32.whl
Algorithm Hash digest
SHA256 ff5d2159c5d93015f5a4542aac6c315506df31853123aa39042672031768c301
MD5 3b8441fd663b3ad829218fabd80eb91b
BLAKE2b-256 7daade1a09833e42190afca916a97c9d806cbca2d5028dc3ee912f00cfa6d7a6

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 65975094fef8cc68919644936764efd2ce98cf1bacbe8db2687155d2b0625bee
MD5 c84372e32d414262f799fa0fd09504d5
BLAKE2b-256 0483e690fb202d97a0745e8d455666135476b0664bd24813258e7acc8096cffa

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 4525f6997d81d9b6d9140088f4f5131f6627e4c960c2c87d0695ae7304233fc3
MD5 4690f34937d7071c60f7bdc9582d3836
BLAKE2b-256 347fa7e65e0b6c52ed2660d3f93e845c08f92f7af027b27d129756797446374f

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 0344d6602740e44054a9e5bbe9775a5e149c4dddaff15959bb07dcce95a5a859
MD5 11a311e0bf09eb181d003cd07c763d44
BLAKE2b-256 153b879231a9a80e52a2bd0fcfc7167d5fa31324463a6063f04b5945667a8231

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 3c2b60b12fdd310bf85ce5d7d3f823456b9b65eed30f5438dd7761879c495983
MD5 6670c72c56a95add0aaa85021c3fe6b2
BLAKE2b-256 38b074da61b76cabed102cde8bee882724d94c555e80fbd00afce405357d01b4

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 aab16c4a26d351d63e965b0c792f5da7227a37b69a6dc6d922ff70aa595b1b0c
MD5 1686be10c2db0c5429a945d895cc75f5
BLAKE2b-256 7b7a566a8ed502cd2707bd0e9b3f5905eacacbf462ce5d2bd444005e852e10ab

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 dbed5944c31195514669cf6381a0d8d47f164943000d10f93d6d02f0d45c25e0
MD5 5f230028dab91a9d45ed602a582c55fa
BLAKE2b-256 31bece39ea65bb4845fa7cc2a25bbc1f88dfe9977dd92423f3c467a8c4ec0997

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 ca9db64c7c9954fbae698884c5bb089764edc549731e5f9b7fa1dd4e4d78d77f
MD5 e001344096d02774bc89dfdd35c8238c
BLAKE2b-256 92d95faa5a1620bf1417dbcc016db0d287c3ecf3137c3b9b75c9b077d698f7d0

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 32371008788aeeb0309a9244809a23e4c0259625e6b74a103700f6421373f395
MD5 fae49bd9784c40c408d5646d6b9ae6b7
BLAKE2b-256 822516c83c91667aea480750c22c3570e07a538fa85db3186bcdbf43964dfe45

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c3d7343fa562ea29661783344a2d83662db0d3d17a6fa6a403cac8e512d2d9fd
MD5 81ce03a10e51df9623f295486d894ab8
BLAKE2b-256 c50e8961075de3aca5435fa6371088d44594cdc0e59b5b935afdaf1af028cf36

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 af7e9be8c05d30bb137b9fd20f9d99354816599e5fd3d58a4b1e28ba3b36171f
MD5 42f787ff0b400c6b586ced54bb2618d9
BLAKE2b-256 fdb6577d7dd7574c8bdcb75f7fceb3eb957de02956f4bcacaf89ab07c14931a1

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-none-win_amd64.whl
Algorithm Hash digest
SHA256 4b31807cb393d6ea31926b307911c89a1209d5e27629aa79553d1599c8ffdefe
MD5 c0f8910c402ed28b25bd62c780882a0d
BLAKE2b-256 42db0061fb8004ce9173b9249a0c323c799be51f2c8e6d4ff3cc38b549c3f8b6

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.15.0-cp310-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.10, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.15.0-cp310-none-win32.whl
Algorithm Hash digest
SHA256 9a3241acdc9b44cff6e95c4a55b9be943ef3658f8edb3686034d353734adba05
MD5 3b9b1fc23ce8112c907044845e64adc9
BLAKE2b-256 c7d5a7aaee753af6fe80655e1a43836e7090665f3fe970b971d00f6cb65e26b4

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 ae17884aafb3e94f34fb7cfedc29054f5f54e142475ebf8a265a4e388fee3f8b
MD5 61f6ed4f10fcab90f7755e20aa47c097
BLAKE2b-256 3a3a20011160a525a9be04348d1472778627ab4df3ce17ba9428d9f839407a79

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 8edcc90a36eab0705fe9121d6c77c6e42eeef25c7399864fd57dfb27173060bf
MD5 1a0400b6b454fb917fbfaf7750f3667b
BLAKE2b-256 24e2c804dd1d19f66408bc10be055077fb04826b4a5fd956d6d8b7c505b54339

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 de9529fe75efcd54ba8d516aa725e1851df9199f0669b665c55e90df08f5af86
MD5 178c6adfc09f10aae167acb89e62422e
BLAKE2b-256 eb3deee5f3c572a3f4db2ebabf5bd4f284f356078a5b5d27e6229b4450d5c5e4

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 9855e6c258918f9cf62792d4f6ddfa6c56dccd8c8118640f867f6393ecaf8bd7
MD5 3de87c466540d91211fa7c2e70231e3b
BLAKE2b-256 52ed6878cabf8e4621f215b526e39a2b078b3d84d68a0c997ad9ea3a8c868f80

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 f1480b0051d8ab5408e8e4db2dc832f7082ea24aa0722c427bde2418c6f3bd07
MD5 bae706f69b939535755ee244d272c18b
BLAKE2b-256 f43cf8490ce17c2755ddaa2c52e6d01ff10b911edb4118d75d19a11b00ea7d28

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 6fdcc55339df7761cd52e1fbe8185d3b3963bc9e3f3545faa6c84f9e8818259a
MD5 2a1f7f3625fef3bba18c7a4af3d4ccb4
BLAKE2b-256 d7e12192ce2674313fdb8f4cf1e049bfc29d7572eb4965a2986bdcee359aa87a

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 88dd0961c437d413ab027f8b115350c121d49902cfbadf08bb8f634b15fa1814
MD5 5c7a4d67addf092f82b8957ff883927e
BLAKE2b-256 93ca2fccc04052aaef0d19f6cbd00ee0ed878b3268256dddb730d6deb2771029

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 331dd786d02fc38698f835fff61c99480f98b73ce75a4c65bd110c9af5e4609a
MD5 09e99fcf9bb3e7cfa4f4aec4c16a0ce3
BLAKE2b-256 11e8c09a83938c5451dc04f9f92c3ab3a4e770c3586523c4dc20a69b126df7d2

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8a922c492c721744ee175f15b91704be2d305569d25f0547c77cd6c9f210f9dc
MD5 e00571a8abeb511922623fc8a3c169f8
BLAKE2b-256 744a119371191a5290ee5169dded0c2b542668a2c86798511c7045b480f0c7ed

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 cd3cd0299aaa312cd2988957598f80becd04d5a07338741eca076057a2b37d6e
MD5 0d2b511f8f1a5a3b722a05f98908084b
BLAKE2b-256 eb49a1997df128eec8b833e12824be47cb32d4d82e4933409d2e4abb577818ad

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-none-win_amd64.whl
Algorithm Hash digest
SHA256 edde9aa964145d528d0e0dbf14f244b8a85ebf276fb76869bc02e2530fa37a96
MD5 04d1d5d168e766432c764b2d6bdfb6a1
BLAKE2b-256 9f90a6821e7757d2db194c16cbca78c80e206f30f6cc62c7f15fb27428f8c6dd

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.15.0-cp39-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.9, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.15.0-cp39-none-win32.whl
Algorithm Hash digest
SHA256 b8034f1041fd2bd2b84ff9f4dc4ae2e1c3b71606820a9cd5c562ebd291a396d1
MD5 b2a6b65c5f251b6f94243d8d51060e59
BLAKE2b-256 675087c3ad17f14b1af2fc18aec08dd40b54e83f2d22264370893aab2b23c55b

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 e58a38c4e6075810bdfb861d9c005236a72a152ebc7005941cc90d1bbf16aca9
MD5 259f47379a1ea6dce60b2bde13284685
BLAKE2b-256 f6e1174d56a4202b34a941d3f8237121c4bbdff4eb1380a92d8747b86ba3069b

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 4a522612d5c88a41563e3463226af64e2fa00629f65cdcc501d1995dd25d23f5
MD5 16f7a2d4549bec571a9be95c438991e8
BLAKE2b-256 0d024fb44c10d71e0188239a20172c212660dc86b4e9510f865f6bb297f339cf

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ab806ad521a5e9de38078b7add97589c313915f6f5fec6b2f9f289d14d607bd6
MD5 289624917ca75e963385d7196d093104
BLAKE2b-256 76537f30dd413a607224b9ccc7b8b27a311095cbb7c3058c069971dc95ec7844

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 cbbf2489fcf25d809731ba2744ff278dd07d9eb3f8b7482726bd6cae607073a4
MD5 73c73975699fbc389546faeb14876a92
BLAKE2b-256 1fac606ae87d14f62470f6922f25ec0422688d51df59fcb171d75c3c659bece3

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 05b83896a893cdfedad8785250daa3ba9f0504848323471524d4783d7291661e
MD5 5b1eb0f11a3ec965dcf7a514b8e1f3e1
BLAKE2b-256 66263751364b60c758ca7a572019b987bc3b29e2382d41956f14d311e53d00ef

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 01a3aa332abc4bee7640563949fcfedca4de8f52691b3b70f2fc6ca71bfc0f4e
MD5 5bbf9e5affb8d44f0045375cb7aa0427
BLAKE2b-256 2cc92eb185ce9c9419710fd80ab85067db886f099130850e96891a485800cb94

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 a79f17027f24fe9485701c8dbb269b9c713954ec3bdc1e7075a66086c0c0cd3c
MD5 654842bfea1b550efd6be823051441ec
BLAKE2b-256 14cf883acc48862589f9d54c239a9108728db5b75cd6c0949b92c72aae8e044c

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 a9fcaad9ab0801f14457d7c820d9f246b5ab590c407fc6b073819b1573097aa7
MD5 b0eac28d9fd8f7748301e12f00128916
BLAKE2b-256 c724ac0e9c2337d58432c6465faaab7446db40c2af05c06f7d8018407df7f648

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c3045d191dad49647f5a5039738ecf1c77087945c7a295f7bcf051c37067e883
MD5 f1d02b8bd9de03b332bd3dc545345580
BLAKE2b-256 9e2d35a9f9378962fd954cd097efc0d3b7beee86c12d4e61cf6199bdef58e091

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 3661862df7382c5eb23ac4fbf7c75e69b02dc4f5784e4c5a734db406b5b24596
MD5 6f95f0d776433dd518318d474bad50c6
BLAKE2b-256 9001e0c2b710e5c19a0c9cf3a107db67b56d08bf38cd4ed125c0f32a52ffc675

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-none-win_amd64.whl
Algorithm Hash digest
SHA256 f17cbd88dab695911cbdd385a5a7e3709cc61dff982351f5d1b5939f074a2466
MD5 df0f001ac1aceceefb0cd19d632fc8e2
BLAKE2b-256 bb0f8d583f3aac636dca3287a8ba5ef12cd898526ee5f8cffa7348a7a0a7ac76

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.15.0-cp38-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.8, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.15.0-cp38-none-win32.whl
Algorithm Hash digest
SHA256 9680b0ecc26e7e42f16680c1aa62e924d58d1c2dd992707081cc10a374896ea2
MD5 534c807e0fa234baf50e95beae5f5302
BLAKE2b-256 38e679de82e45aa9768346035a46eb7a880b4f793c0421bae75cb890ca1b28c6

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 72f78b0e0e276b1fc14a672fa73f3acca034ba8db4e782124a2996734a9ba9cf
MD5 cd5fa426f7c416814739f62da48fca30
BLAKE2b-256 a708871009b7bdf35063927bad2e3ad8531bbc2f123c4f7300b17db961dae36c

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 aabc83028baa5a36ce7a94e7659250f0309c47fa4a639e5c2c38e6d5ea0de564
MD5 c38da29b5a8dca8d31885ebaade4204a
BLAKE2b-256 ab857f384dc60b57cb051205eda565798ddb7ef70bf5a0005a37135f389b47a9

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 7286f3df10de840867372e3e64b99ef58c677210e3ceb653cd0e740a5c53fe78
MD5 367413fbb338918b95f50c1241c15749
BLAKE2b-256 ad7556230c5c65b226e707e1adbc759c19fdf1b20bb02c0276796b132c97118a

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 b3cdf29e6f9653da330515dc8fa414be5a93aae79e57f8acc50d4028dd843edf
MD5 5520591c2183c14f845b8fa56b8e4220
BLAKE2b-256 a2b85adfd6b030ba741beb31b23632045d30cf2cb16f06d7644bec3a5970ba1f

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 f8d16b647032df2ce2c1f9097236e046ea9fedd969b25637b9d5d734d78aa53b
MD5 6ae17b2f7503ac98d4b3d5b3649f41c5
BLAKE2b-256 ba71a3affa6aab0453d819a375e3d12c7eee96978724c8df10468ba1266d0b70

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 7c7982fd0ec9e9122d03b209dac48cebfea3de0479335100ef379a9a959b9a5a
MD5 d0a5744cc9cc8835521e78e4fe4bcbd7
BLAKE2b-256 c6cb9807b2513e267a46faf3ac835e9d92745b3d6c3e3e83ab6493d193d81196

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 1574a5a4af22c3def93fe8fe4adcc90a39bf5797ed01686a4c46d1c3bc677d2f
MD5 bccfa61d7480cba497476c2d8697e26b
BLAKE2b-256 b891b5a161e3baa3cbcf356f87d4594f72cd348598c4a2c4074744ab4cad8b2c

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 f8aa81afec893e952bd39692b2d9ef60575ed8c86fce1fd876a06d2e73e82dca
MD5 a53f3da640a9712c3019d9c6ef902bf9
BLAKE2b-256 ae2bdf01cfd5ec2d9b14da2748e2de67e71796cee7816e7614e5d7795661dbd1

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 2a5f4543a35889679fc3052086e69e81880b2a5a28ff2a52c5a604be94b77a3f
MD5 f94d14972fa1499b08ce150d3431cacf
BLAKE2b-256 dc0781a33aea5bd7cf4a2366868d62617962edd226bb68fcadb17496a1f980b0

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 f21c9eb71c9a671e2a42f18b456a3d118e50c7f0fc4dd9fa8f4eb727fea529bf
MD5 e2e53b38bdb0797c85a7580f1746f5d9
BLAKE2b-256 0284e72e04515bb861ec91ac0604d6d01ed6bfe0166b6f8aa5e0a023a649c465

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-none-win_amd64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-none-win_amd64.whl
Algorithm Hash digest
SHA256 1ab96ab7dc706e002c32b2ea211a94c1c04b4f4de48354728c3a6e22401af322
MD5 a6e6940ef01d334b510dc4d70a7a858f
BLAKE2b-256 0ad6d3b35366686ed5614aa5ab6319535f9ee250b5947cfd425ef7df77d34f6b

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-none-win32.whl.

File metadata

  • Download URL: tokenizers-0.15.0-cp37-none-win32.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.7, Windows x86
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for tokenizers-0.15.0-cp37-none-win32.whl
Algorithm Hash digest
SHA256 cdd945e678bbdf4517d5d8de66578a5030aeefecdb46f5320b034de9cad8d4dd
MD5 5d35ab3a5da6da392f6fe4599568320f
BLAKE2b-256 c47bb44eee274b546ea671db617996a0c6010601e8a3200ecb6a7ffe54270fb1

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 bc80a0a565ebfc7cd89de7dd581da8c2b3238addfca6280572d27d763f135f2f
MD5 9b6491851e89d883cbf3bda0037a3f7c
BLAKE2b-256 75fbeaa67f8f0c67d2f738cf4226a88c2388464fcbb257b75caec1a55e58cf8d

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 0ea480d943297df26f06f508dab6e012b07f42bf3dffdd36e70799368a5f5229
MD5 f1409b62819f149c11dc4ad68b0ccf72
BLAKE2b-256 9ab69ed893aba8aa50e8774669a49faeeac4bddfb6cc0860c602647787d89150

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 669b8ed653a578bcff919566631156f5da3aab84c66f3c0b11a6281e8b4731c7
MD5 833b3a9c98c4b4abf185a5f426e14d0b
BLAKE2b-256 cab82f10f4eeba903f726c5826580d82286aed64a6b95aa1d76359977f0bf5b9

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm Hash digest
SHA256 e54c5f26df14913620046b33e822cb3bcd091a332a55230c0e63cc77135e2169
MD5 02f36cec9fbdcb162d68ecc62d5c1baf
BLAKE2b-256 cfcbd8d692460ab2c98bdda1ab7ff39b1364d95994cc11310e2d61ca1cd96a5d

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm Hash digest
SHA256 26a2ef890740127cb115ee5260878f4a677e36a12831795fd7e85887c53b430b
MD5 b6ae73d6171e54e702091909d81eb2d5
BLAKE2b-256 5a4f0753ee4c0255e14f009f04b9fb1807b6e62fc3a729906ccfb99576979c6b

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm Hash digest
SHA256 05accb9162bf711a941b1460b743d62fec61c160daf25e53c5eea52c74d77814
MD5 07f833dc855d912c6b117edcb7b640eb
BLAKE2b-256 02e86e89a0dfce2b976020ae20ed70de4213aa19830630a018529da5febde912

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 caadf255cf7f951b38d10097836d1f3bcff4aeaaffadfdf748bab780bf5bff95
MD5 633a086de11a2365188d42d4bfa7fed6
BLAKE2b-256 50edcc0b62a889985e95931d9ee3440bdcafffbab50f4b0583818c31a9339aba

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm Hash digest
SHA256 5d37e7f4439b4c46192ab4f2ff38ab815e4420f153caa13dec9272ef14403d34
MD5 6351f51b9e92b6918d609df5b97768bf
BLAKE2b-256 5616dfb95fab50be691444ca5bf39a2bc0371b50582ea8869ab96704ef6e0134

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b7bee0f1795e3e3561e9a557061b1539e5255b8221e3f928f58100282407e090
MD5 9504fe77ce84fc6b048648f4320b615d
BLAKE2b-256 64e313b0e31f2bfb4a9f25a214891ae388f6e2ee78687a97eaaf5a3455a6b275

See more details on using hashes here.

File details

Details for the file tokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for tokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 6fe143939f3b596681922b2df12a591a5b010e7dcfbee2202482cd0c1c2f2459
MD5 bce613d7553aa9f34b6432dd93811324
BLAKE2b-256 bae8b7cba05e3517b8cd9b7a892064cfa12e64671531c776bb27b0ffe00f78e1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page