sappho192 

.NET wrapper of HuggingFace Tokenizers library

Native(Rust) wrapper of HuggingFace Tokenizers library.

Minimal Tokenizer implementation of BertJapanese(tohoku-nlp/bert-base-japanese) in C#

Text translator library based on LLM models, especially EncoderDecoderModel in HuggingFace

Native(Rust) wrapper of HuggingFace Tokenizers library.

Native(Rust) wrapper of HuggingFace Tokenizers library.

Native(Rust) wrapper of HuggingFace Tokenizers library.

Native(Rust) wrapper of HuggingFace Tokenizers library.

This fork is a lightweight version of the original library and only has ChatLog functionality.