2 个不稳定版本
| 0.2.0 | 2022 年 8 月 15 日 |
|---|---|
| 0.1.0 | 2021 年 1 月 9 日 |
#595 in HTTP 服务器
28KB
569 行
Kio
通过 Cli 与 Kafka 交互
- 读取或尾随流
- 写入流
- 公开元数据
示例
特定主题上的最后 3 条消息
kio -b kafka:9092 read -s -3 collectd | jq -c
[{"values":[36.5],"dstypes":["gauge"],"dsnames":["value"],"time":1660539487.832,"interval":10,"host":"nuc","plugin":"thermal","plugin_instance":"thermal_zone1","type":"temperature","type_instance":""}]
[{"values":[196.598768966493,0],"dstypes":["derive","derive"],"dsnames":["user","syst"],"time":1660539487.832,"interval":10,"host":"nuc","plugin":"memcached","plugin_instance":"","type":"ps_cputime","type_instance":""}]
[{"values":[0],"dstypes":["gauge"],"dsnames":["value"],"time":1660539487.832,"interval":10,"host":"nuc","plugin":"thermal","plugin_instance":"cooling_device0","type":"gauge","type_instance":""}]
将消息写入主题
echo '{"k":"v"}' | kio write kio
kio read -s -1 collectd | jq -c
{"k":"v"}
安装
cargo安装 kafka-io
用法
Interact with Kafka over stdout/stdin
USAGE:
kio [OPTIONS] [SUBCOMMAND]
OPTIONS:
-b <host[:port]> Broker URI authority [default: localhost:9092]
-g <GROUP_ID> [default: kio]
-h, --help Print help information
-i <POLL_INTERVAL> Interval in seconds to poll for new events [default: 5]
-v <UINT> Sets the level of verbosity [default: 0]
-V, --version Print version information
SUBCOMMANDS:
help Print this message or the help of the given subcommand(s)
partitions List partitions for a given topic
read Read a specific range of messages from a given topic
tail Continuously read from a given set of topics
topics List topics
write Write an NLD set of messages to a given topic
写入
Write an NLD set of messages to a given topic
USAGE:
kio write [OPTIONS] <TOPIC>
ARGS:
<TOPIC> Topic name
OPTIONS:
-h, --help Print help information
-s <UINT> Buffer size [default: 100]
示例： echo '{"k"}' | kio write topic
读取
Read a specific range of messages from a given topic
USAGE:
kio read [OPTIONS] <TOPIC>...
ARGS:
<TOPIC>... Topic name
OPTIONS:
-e, --end <OFFSET> End offset inclusive [default: -1]
-f, --full Encapsulate payload in the message metadata
-h, --help Print help information
-s, --start <OFFSET> Starting offset exclusive [default: 0]
示例： kio read topic | jq -c
主题
List topics
USAGE:
kio topics
OPTIONS:
-h, --help Print help information
示例
$ cargo run -q --bin kio -- -b nuc:9092 topics
+----------+--------------+------------------+--------------------+---------------+----------------+
| Topic | Partition ID | Partition Leader | Partition Replicas | Low Watermark | High Watermark |
+----------+--------------+------------------+--------------------+---------------+----------------+
| bar | 0 | 0 | 1 | 42 | 204 |
+----------+--------------+------------------+--------------------+---------------+----------------+
| bar | 1 | 0 | 1 | 47 | 188 |
+----------+--------------+------------------+--------------------+---------------+----------------+
| foo | 0 | 0 | 1 | 36 | 36 |
+----------+--------------+------------------+--------------------+---------------+----------------+
分区
List partitions for a given topic
USAGE:
kio partitions <TOPIC>
ARGS:
<TOPIC>
OPTIONS:
-h, --help Print help information
示例
$ kio partitions topics
+--------------+------------------+--------------------+---------------+----------------+
| Partition ID | Partition Leader | Partition Replicas | Low Watermark | High Watermark |
+--------------+------------------+--------------------+---------------+----------------+
| 0 | 0 | 1 | 42 | 204 |
+--------------+------------------+--------------------+---------------+----------------+
| 1 | 0 | 1 | 47 | 188 |
+--------------+------------------+--------------------+---------------+----------------+
依赖关系
~22–31MB
~387K SLoC