Apache is most using tool for messaging or communication between to distributed system as compare to Active_MQ & Rabbit_MQ
Like as: it is using in Stock market where billions data change with the minutes and also using Zomato, Uber or Ola system, when the delivery boy or driver change ther location than all location can see by user. The best thing in Apache kafka is that it contains high level fo TP or Through-Put (or Read and Write operation perform very fast).
Apache kafka mostly using in MicroService Architecture based projects. It is used as a communicator between 2 microservice for communication as Producer(or Sender) and Consumer(or Receiver). Between Producer and Consusmer, it is work as Broker.
In this session we are providing Kafka concepts like topics, replication, partitions, etc and you can use them to quickly revise essential Apache Kafka concepts before interviews.
1). What is Apache Kafka? (Most Imp Question)
Kafka is communication tool or messaging communication tool which is used to data transfer between distributed system by publishing and consumer model.
or
Apache Kafka is a stream-processing framework and it is a Producer-Consumer based messaging system developed by Linkedin then acqure by Apache and written in Scala and Java.It is an distributed open-source which is use to Log service and a message broker application. The design pattern of Kafka is mainly based on the design of the transactional log.
2). What are the various components that you can see in Apache Kafka? (Most Imp Question)
These are the key components of any Apache Kafka cluster:
. Producer(or Sender): Producers, publish the messages to a specific Kafka topic.
. Consumer(or Receiver): Kafka Consumers are used to subscribing a topic and also read and process messages from the topic.
. Brokers: Brokers are a set of servers that has the capability of storing publisher messages. They are used to manage
the storage of messages in the topic.
. Topic: It is is a collection or a stream of messages.
. Partition: In every Kafka broker, there are few partitions available. And, here each partition in Kafka can be either a leader or a replica of a topic.
. Offset: There is a sequential ID number given to the messages in the partitions what we call, an offset. So, to identify each message in the partition uniquely, we use these offsets.
. Note: One producer can send message to multiple consumers.
3). What is the key points of Apache Kafka ? (Imp Question)
Some key features of Apache Kafka are given below:
. High Throughput: Kafka supports millions of messages
. Scalability: kafka highly scalable distributed systems with no downtime.
. Replication: Kafka messages are duplicated across the cluster to enable numerous subscribers.
. Durability: Kafka support for persistence of messages to disk.
. Stream processing: kafka Used in real-time streaming applications.
Note : To download the apache kafka by this link : apache kafka donwload
4). What are the key benefits or advantage of Apache Kafka over the other messaging techniques?
These are the list of key benefits of Apache Kafka above other traditional messaging techniques:
. Fast: Kafka is extremely fast because a single Kafka broker can serve thousands of clients by handling megabytes of reads and writes per second.
. Scalable: In Kafka, we can partition data and streamline over a cluster of machines to enable larger data.
. Durable: In Kafka, messages are persistent and are replicated within the cluster to prevent data loss. That’s why Kafka is durable.
. Distributed by Design: Kafka provides fault tolerance features, and its distributed design also guarantees durability
5).Disadvantages of Kafka?
Some of the disadvantages are given below:
. Certain message types like point-to-point queues and request/reply are not supported by Kafka.
. There are no complete monitoring tools in Apache Kafka.
. When messages are tweaked, Kafka’s performance suffers. Kafka works well when the message does not need to be updated.
. Kafka does not support wildcard topic selection. It’s crucial to use the appropriate issue name.
6). What is the role of the ZooKeeper in Kafka? (Imp Question)
Apache Kafkais a distributed system is built to use Zookeeper. Although, Zookeeper’s main role here is to build coordination
between different nodes in a cluster. However, we also use Zookeeper to recover from previously committed offset if any node fails because it works as periodically commit offset.
7). We can use kafka without ZooKeeper ? or Is it possible to use Kafka without ZooKeeper? (Imp Question)
It is impossible to bypass Zookeeper and connect directly to the Kafka server, so the answer is no. If somehow, ZooKeeper is down, then it is impossible to service any client request.
8). What are main APIs of Kafka?
Apache Kafka has 4 main APIs:
. Producer API
. Consumer API
. Streams API
. Connector API
Note: For Spring boot , see the apche kafka dependency lik here : apache kafka dependency
9). What is a Consumer Group?
The concept of Consumer Groups is exclusive to Apache Kafka. Basically, every Kafka consumer group consists of one or more
consumers that jointly consume a set of subscribed topics.
10). What is the concept of Leader and Follower ? Explain the the concept of Leader and Follower.
In every partition of Kafka, there is one server which acts as the Leader, and none or more servers plays the role as a Followers.
11). What is the maximum size of a message that can be received by the Kafka? (Imp Question)
The maximum size of a message that can be received by the Kafka is approx. 1000000 bytes.
12). What are the types of traditional method of message transfer?
There are 2 methods of the traditional message transfer method:
Queuing: It is a method in which a pool of consumers may read a message from the server and each message goes to one of them.
Publish–Subscribe: Whereas in Publish-Subscribe, messages are broadcasted to all consumers.
Note: For more information please check out this link : Apache official website
——————————————————————————————————————————————————————————————————————
People alos ask- kafka | kafkaesque | kafka build | kafka on the shore | kafka honkai star rail | kafka honkai | kafka books | kafka connect | kafka hsr | kafkaesque meaning | what kafka is used for | what kafka should i read first | what kafka | what kafkaesque meaning | what kafka on the shore is about | what kafka does | what kafka do | what kafka should i read | what kafka books to read | kafka examples | how kafka works | how kafka partition works | how kafka consumer works | how kafkaesque | how kafka died | how kafka works internally | how kafka connect works | how kafka offset works | how kafka streams work | how kafka stores data | what kafka is used for | what kafka should i read first | what kafka | what kafkaesque meaning | what kafka on the shore is about | what kafka does | what kafka do | what kafka should i read | what kafka books to read | kafka examples | when kafka rerun | when kafka was the rage | when kafka release star rail | when kafka banner | when kafka banner rerun | when kafka is used | when kafka said | when kafka rebalance | when kafka delete message | when kafka star rail | why kafka is fast | why kafka | why kafka is used | why kafka rebalance happens | why kafka uses zookeeper | why kafka is used in microservices | why kafka has high throughput | kafka for beginners | kafka for dummies | kafka for windows | kafka for python | kafka for etl | kafka format | kafka for video streaming | kafka force rebalance | kafka forwarder | kafka for messaging