tokenizers | Hex

tokenizers 0.5.1

Bindings to Hugging Face Tokenizers for Elixir

Links

License

Apache-2.0

Downloads

554 554
this version
294 294
yesterday
4 983 4 983
last 7 days
294.2K 294 154
all time

Versions (10)

0.5.1 Oct 02, 2024
0.5.0 Apr 24, 2024
0.4.0 Aug 09, 2023
0.3.2 Apr 19, 2023
0.3.1 Apr 06, 2023

Show All Versions

Dependencies (3)

castore ~> 0.1 or ~> 1.0
rustler >= 0.0.0 (optional)
rustler_precompiled ~> 0.6

Recent Activity

Oct 02, 2024 Publish documentation for release 0.5.1
Oct 02, 2024 Publish release 0.5.1
Apr 24, 2024 Publish documentation for release 0.5.0
Apr 24, 2024 Publish release 0.5.0
Aug 09, 2023 Publish documentation for release 0.4.0
Aug 09, 2023 Publish release 0.4.0
Apr 19, 2023 Publish documentation for release 0.3.2
Apr 19, 2023 Publish release 0.3.2
Apr 06, 2023 Publish documentation for release 0.3.1
Apr 06, 2023 Publish release 0.3.1

Show All Activities

Config

mix.exs

rebar.config

erlang.mk

Checksum

Build Tools

mix

Owners

Publisher

Dependents (1)

bumblebee, show all...