Apache Kafka β , , . , prefetch, zero-copy β , . , , β , Kafka.
. , (. . ) β , . . Kafka .
Apache ZooKeeper. : , . . ZooKeeper , , , - API . Kafka β API pub/sub (-) . , , , , β . , ZooKeeper Kafka.
, , .
, KIP-500 Kafka β Zookeeper. !
β (Ben Stopford)
, KIP-500 trunk 2.8. Kafka ZooKeeper. Kafka Raft Metadata, βKRaft ( «»).
. ACL . JBOD KRaft (, Apache Kafka ). . : , Kafka , ( . ).
:
Kafka , , Kafka ZooKeeper, , Kafka. , .
. KRaft, . ZooKeeper ZAB Raft, β , , .
, - . , ( ), , . , . , , . .
KRaft , ZooKeeper ZooKeeper, . . , , KRaft. , RPC, . ( , ) β Kafka , . .
Kafka
Kafka : . . KIP , . Kafka . , .
. , , 2018 , Kafka. , . O ( ). , Kafka.
, , 200K . , (ZooKeeper) ( Kafka). . , . 2 ( 10 ):
ZooKeeper | ||
---|---|---|
(2 ) | 135 | 32 |
(2 ) | 503 | 37 |
. , rolling restart β . , (RTO) , , , , , -. , , ZooKeeper.
, , β . , 2018 .
Kafka β
Kafka , ZooKeeper. - , ActiveMQ RabbitMQ, Kafka .
, Kafka , Netflix Instagram. , Kafka , Kafka Streams, ksqlDB . (Kafka Zookeeper) , .
. KIP-500 KRaft Kafka , ActiveMQ RabbitMQ. . . , , Confluent Cloud, . , , , β . , .
Kafka ZooKeeper
, , , Apache Kafka 2.8. ? β , , Kafka , .
, , , . KRaft Early Access, . , TLA+ Confluent Cloud.
. . README GitHub.