character_converter

关于

将繁体中文转换为简体中文，反之亦然。检查字符串脚本以确定字符串是繁体中文还是简体中文。

此包还包括一个最大匹配分词器。

用法

extern crate character_converter;

use character_converter::{is_traditional, is_simplified, traditional_to_simplified, simplified_to_traditional, tokenize};

let traditional_text = "歐洲";
let simplified_text = "欧洲";

// Check script
assert!(is_traditional(traditional_text));

assert!(!is_simplified(traditional_text));

// Convert script
let result_three = traditional_to_simplified(traditional_text);
assert_eq!(result_three, simplified_text);

let result_four = simplified_to_traditional(simplified_text);
assert_eq!(result_four, traditional_text);

// Tokenize
let string = "好好学习天天向上.";
let tokens = vec!["好好", "学习", "天天", "向上"];
assert_eq!(tokens, tokenize(string));

基准测试

使用夜间基准测试功能运行基准测试

cargo +nightly bench --features=bench

许可证

MIT