Lib.rs

› 关键词 #bindings #tokenizer #esaxx #tree #esaxxx #suffix-array #cpp #text

#sentence-piece

  1. esaxx-rs

    包装sentencepiece的esaxxx库

    v0.1.10 143K #suffix-array #sentence-piece #tree #bindings #esaxxx #esaxx #cpp

  2. sentencepiece

    句子分割词法分析器的绑定

    v0.11.2 1.7K #binding #tokenizer #sentence #unsupervised #text #sentence-piece-processor

  3. sentencepiece-model

    从SentencePiece protobuf定义生成的句子分割模型解析器

    v0.1.3 #nlp #sentence-piece #machine-learning #tokenizer #sentencepiece

  4. spm_precompiled

    旨在模拟https://github.com/google/sentencepiece Dart::DoubleArray结构及其正常化器。这个crate非常专业，不适用于通用用途。

    v0.1.4 140K #double-array #precompiled-charsmap #sentence-piece #darts

  5. sentencepiece-sys

    句子分割词法分析器的绑定

    v0.11.2 1.8K #sentence-piece #bindings #tokenizer

    6. 尝试使用DuckDuckGo搜索。