tokenizers | Hex

tokenizers 0.3.0

Bindings to Hugging Face Tokenizers for Elixir

Links

License

Apache-2.0

Downloads

3 501 3 501
this version
882 882
yesterday
4 326 4 326
last 7 days
434.3K 434 299
all time

Versions (10)

0.5.1 Oct 02, 2024
0.5.0 Apr 24, 2024
0.4.0 Aug 09, 2023
0.3.2 Apr 19, 2023
0.3.1 Apr 06, 2023

Show All Versions

Dependencies (3)

castore ~> 0.1 or ~> 1.0
rustler >= 0.0.0 (optional)
rustler_precompiled ~> 0.6

Recent Activity

Feb 18, 2025 Remove level full owner philip
Oct 02, 2024 Publish documentation for release 0.5.1
Oct 02, 2024 Publish release 0.5.1
Apr 24, 2024 Publish documentation for release 0.5.0
Apr 24, 2024 Publish release 0.5.0
Aug 09, 2023 Publish documentation for release 0.4.0
Aug 09, 2023 Publish release 0.4.0
Apr 19, 2023 Publish documentation for release 0.3.2
Apr 19, 2023 Publish release 0.3.2
Apr 06, 2023 Publish documentation for release 0.3.1

Show All Activities

Config

mix.exs

rebar.config

erlang.mk

Checksum

Build Tools

mix

Owners

elixir_nx

Publisher

philip

Dependents (1)

bumblebee, show all...