Add partitions to existing topic with optional replica assignment
Add partitions to existing topic with optional replica assignment
Zookeeper utilities
Topic for adding partitions to
Number of partitions to be set
Manual replica assignment
Ignore checking if assigned replica broker is available. Only used for testing
There are 2 goals of replica assignment: 1.
There are 2 goals of replica assignment: 1. Spread the replicas evenly among brokers. 2. For partitions assigned to a particular broker, their other replicas are spread over the other brokers.
To achieve this goal, we: 1. Assign the first replica of each partition by round-robin, starting from a random position in the broker list. 2. Assign the remaining replicas of each partition with an increasing shift.
Here is an example of assigning broker-0 broker-1 broker-2 broker-3 broker-4 p0 p1 p2 p3 p4 (1st replica) p5 p6 p7 p8 p9 (1st replica) p4 p0 p1 p2 p3 (2nd replica) p8 p9 p5 p6 p7 (2nd replica) p3 p4 p0 p1 p2 (3nd replica) p7 p8 p9 p5 p6 (3nd replica)
Update the config for a client and create a change notification so the change will propagate to other brokers
Update the config for a client and create a change notification so the change will propagate to other brokers
Zookeeper utilities used to write the config to ZK
Update the config for an existing topic and create a change notification so the change will propagate to other brokers
Update the config for an existing topic and create a change notification so the change will propagate to other brokers
Zookeeper utilities used to write the config to ZK
Delete every inactive consumer group's information about the given topic in Zookeeper.
Delete every inactive consumer group's information about the given topic in Zookeeper.
Zookeeper utilities
Topic of the consumer group information we wish to delete
Delete the whole directory of the given consumer group if the group is inactive.
Delete the whole directory of the given consumer group if the group is inactive.
Zookeeper utilities
Consumer group
whether or not we deleted the consumer group information
Delete the given consumer group's information for the given topic in Zookeeper if the group is inactive.
Delete the given consumer group's information for the given topic in Zookeeper if the group is inactive. If the consumer group consumes no other topics, delete the whole consumer group directory.
Zookeeper utilities
Consumer group
Topic of the consumer group information we wish to delete
whether or not we deleted the consumer group information for the given topic
Read the entity (topic or client) config (if any) from zk