This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages)
This article is written like a manual or guide. Please help rewrite this article and remove advice or instruction.(November 2023)
This article may rely excessively on sources too closely associated with the subject, potentially preventing the article from being verifiable and neutral. Please help improve it by replacing them with more appropriate citations to reliable, independent, third-party sources.(November 2023) (Learn how and when to remove this template message)
(Learn how and when to remove this template message)
Apache Kafka[1]
Original author(s)
LinkedIn
Developer(s)
Apache Software Foundation
Initial release
January 2011; 13 years ago (2011-01)[2]
Stable release
3.7.0[3]
/ 26 February 2024
Repository
github.com/apache/kafka
Written in
Scala, Java
Operating system
Cross-platform
Type
Stream processing, Message broker
License
Apache License 2.0
Website
kafka.apache.org
Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system developed by the Apache Software Foundation written in Java and Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. Kafka can connect to external systems (for data import/export) via Kafka Connect, and provides the Kafka Streams libraries for stream processing applications. Kafka uses a binary TCP-based protocol that is optimized for efficiency and relies on a "message set" abstraction that naturally groups messages together to reduce the overhead of the network roundtrip. This "leads to larger network packets, larger sequential disk operations, contiguous memory blocks [...] which allows Kafka to turn a bursty stream of random message writes into linear writes."[4]
^"Apache Kafka at GitHub". github.com. Retrieved 5 March 2018.
^"Open-sourcing Kafka, LinkedIn's distributed message queue". Retrieved 27 October 2016.
^"Release 3.7.0". 26 February 2024. Retrieved 19 March 2024.
ApacheKafka is a distributed event store and stream-processing platform. It is an open-source system developed by the Apache Software Foundation written...
systems such as Apache Doris, Amazon Kinesis, ApacheKafka, HDFS, Apache Cassandra, and ElasticSearch. Apache Flink is developed under the Apache License 2...
technology company. She co-created the open source software platform ApacheKafka. Narkhede now serves as a board member of Confluent. In 2020, she was...
and Azure Service Bus, WebSphere MQ, Solace PubSub+, Rabbit MQ, ApacheKafka and Apache Pulsar. Poison message Dead letter mail "Dead Letter Channel"....
Foundation in Scala and Java. It has been developed in conjunction with ApacheKafka. Both were originally developed by LinkedIn. Samza allows users to build...
basic_consume(queue="hello", on_message_callback=callback) channel.start_consuming() ApacheKafka Free and open-source software portal Which protocols does RabbitMQ support...
Firehose, allowing users to get started with the services at no cost. ApacheKafka Google Cloud Pub/Sub Microsoft Azure Event Hubs Stream processing Jeff...
added API-level support for messaging tools ApacheKafka, RabbitMQ and Java Message Service, in addition to Apache Pulsar. Astra Streaming can connect to a...
typically used in this layer include ApacheKafka, Amazon Kinesis, Apache Storm, SQLstream, Apache Samza, Apache Spark, Azure Stream Analytics. Output...
products to the open source domain. Notable among these projects is ApacheKafka, which was built and open sourced at LinkedIn in 2011. Massive amounts...
Redis on AWS Graviton2 Arm: Gain up to 30% Cost-Performance benefits for ApacheKafka on AWS Graviton2 Processors AWS: AWS Lambda Functions Powered by AWS...
Druid, IBM's Cloud Object Store, the Arvados Data Management System, ApacheKafka, and the Twitter EventBus pub/sub platform. One of the first applications...
graphs ApacheKafka Stream processing platform Apache Log4j Java logging framework - Log4j 2 is the enhanced version of the popular Log4j project. Apache Lucene...
Kubernetes, and uses ApacheKafka as a messaging service. The data science platform uses Apache Hadoop, Apache Spark, and Apache Hive. PickMe's micoservices...
MS for MongoDB MS for Elasticsearch MS for ApacheKafka. MS for SQL Server MS for Greenplum Data Proc (Apache Hadoop cluster management) Data Transfer (database...
Mutiny Helidon Other implementations include Cassandra, Elasticsearch, ApacheKafka, Parallel Universe Quasar, Play Framework, Armeria. Spring 5 is announced...
notion of ordering of instances is important. Other applications like ApacheKafka distribute the data amongst their brokers; hence, one broker is not the...
be more data-driven, Reddit built a data analytics pipeline on top of ApacheKafka and Hive as its data warehouse. It uses Amazon's Elastic MapReduce to...
Global Information
/ 26 February 2024