Apache Kafka
@apachekafka
Followers
68K
Following
478
Media
10
Statuses
1K
A distributed streaming platform. Account managed by the Kafka PMC.
Joined March 2013
Kafka will use the Raft protocol on top of Kafkas own native commit log to manage metadata in the coming ZooKeeper-free architecture.
6
399
1K
The waiting is over. Apache Kafka 3.5.0 is available now, officially deprecating ZooKeeper. Thanks to all 103 contributors and our RM @MickaelMaison!. For details, check out the release notes and blog post
10
241
894
The core Raft implementation to support ZooKeeper-free Kafka has been merged (including 5k lines of test code). This is a major milestone on the way to KIP-500.
15
316
861
Public Service Announcement: Apache Kafka isn’t a message queue.
15
239
527
Apache Kafka 3.0 is released! 🎉. Another step closer to remove ZooKeeper dependency. And of course many other improvements, bug fixes, and new features. Thanks to 141 contributors and our RM @karantasis!. For more details check out the release blog post:
3
209
524
A GitHub repo of presentations by companies running Kafka in production
2
104
486
We are happy to announce the Apache Kafka 2.4.0 release!. Thanks to all contributors and our release manager Manikumar Reddy. For details check out the release notes:
5
149
372
Kafka Summit 2020 will be virtual and free.
In light of global health concerns, we've decided to transform #KafkaSummit Austin into a virtual experience. We look forward to gathering the global @apachekafka community together for Kafka Summit 2020, Event Streaming Everywhere. Stay tuned for details:
2
127
325
It’s official. After upcoming 2.8 release we will target 3.0!.
4
54
306
We are excited to announce that Apache Kafka 2.8.0 has been released, which includes an early access version of KIP-500! Read today’s blog post by John Roesler to learn more about key new features and improvements:
7
111
304
Kafka only has dark mode.
Excited for the following upcoming product releases:. Dark Mode GitHub.Dark Mode Jira.Dark Mode Kubernetes.Dark Mode Kafka Streams.Dark Mode WebEx.
7
42
294
We are happy to announce the 2.3.0 release!. Thanks to Colin McCabe for running the release. Check out the release notes: Download:
2
160
300
Apache Kafka 3.3 is released! This version marks KRaft as production ready & includes exactly once support for source connectors. Thank you to all contributors and the release manager @jagsancio! Find more details in the release blog post:
4
103
284
PSA: The Kafka logo is supposed to look like a “K”. Unfortunately nobody sees it. Maybe should have splurged for the $299 tier on 99designs. Oh well, at least my logo is better than the ZooKeeper logo. On the other hand, you can definitely tell that’s a zoo keeper.
I just noticed the @apachekafka symbol is also a K. My status as "The Worst" at recognizing visual patterns remains safe.
15
44
259
Apache Kafka 2.6.0 is ready! Thanks to 127 contributors and to our release manager @rhauch. For details see the release blog post .and release notes .. Also check out our updated website!
2
105
256
We are pleased to announce the Apache Kafka 3.7.0 release. The release includes new features, fixes, and improvements from 296 JIRAs. A big “thank you” to all 146 contributors and our RM @BdKozlovski!. For details check out the release blog post:
2
66
244
Time to celebrate: PR number 10000 was opened today! 🎉. Thanks to all contributors who made this milestone possible!.
3
29
244
Apache Kafka 2.5.0 is ready! Thanks to 108 contributors and to our release manager @mumrah!. As always, check out the release notes for details:
3
98
232
The October Kafka release will get the much anticipated 1.0 version number.
2
197
229
Interactive queries against materialized caches with Kafka Streams
0
77
216
Christmas is a few days early this year: Apache Kafka 2.7.0 is released! . Thanks to all elves that contributed to the release and to Santa @bbejeck for delivering it! Also thanks to all the reindeers!. For details check out the release blog post: .
2
75
184
Announcing the Apache Kafka 3.6.0 release, driven by our RM @0xeed and 139 contributors!. - Tiered Storage (Early Access).- migrate clusters from ZK to KRaft with no downtime. For details, check out the blog post and release notes.
0
65
176
Apache Kafka 3.2.0 is released!. Learn all about it from the release blog post: Thanks to all contributors and our release manager Bruno!.
0
45
163
We passed 50k followers. Feels like a milestone. Thank you very much to all of you!. Hope to see you at #KafkaSummit next week!.
6
14
168
How TikTok built Monolith, a system built on @apachekafka and @apacheflink that enables real-time training of a deep neural network for content recommendations
3
35
153
Big architectural projects like removing Zookeeper matter but the little things do too. Here is a KIP to remove an annoying inconsistency in the Kafka command line tools.
2
46
150
A comparison of Kinesis and Kafka by @Insferatu: "Kafka beats Kinesis in all our test cases in every metric. Kafka is also more flexible in terms of adjusting between latency and throughput."
2
50
147
Please join us in congratulating Boyang Chen to becoming a Kafka Committer!. Well deserved!.
10
8
147
“The Hitchhiker’s Guide To Stream Processing”, includes a comparison of a word count app for 7 different frameworks.
0
76
150
A simple example of an event-driven microservice built with Kafka’s streams API
0
49
135
Kafka Fans! Did you notice that Apache Kafka 2.2.1 was released? Get your bug-fixes while they are fresh! For example, the important KAFKA-7974 - in which AdminClient handles DNS failures (Critical for K8s automation!).
3
64
130
"Editor’s Note: It would have been far funnier if Kafka woke up one morning and had been turned into CockroachDB."
0
67
123
Apache Kafka has been nominated for an OSCON 2018 award for the project and community with the most impact. You can read about it and vote here.
1
60
122
"Why streaming data is the future of big data and Apache Kafka is leading the charge"
2
64
120
Secure Kafka running with SSL/TLS is 2.5x faster with Java 9
kafka-producer-perf-test on laptop with TLS achieves 2.5x throughput with Java 9 (AES_256_GCM_SHA384) vs Java 8 (AES_128_CBC_SHA256) (1/2).
1
98
123
Today we passed 10,000 commits!. Thanks to all contributors for reaching this milestone! 🎉. And congrats to @ijuma who is our top contributor to this milestone commit!
0
20
115
Towards a Functional Programming Analogy for Microservices
0
57
113
We are happy to announce that @karantasis accepted our invitation to become an Apache Kafka committer. Join us to congratulate him!.
10
13
109
Great overview of the Kafka message format and how to use serialization and batching to increase throughput.
2
42
104
Apache Kafka 1.0.2 was released - 28 bugs fixed, including 6 blockers. Give yourself the best shot at a rock-stable Kafka deployment by upgrading. Thanks @MatthiasJSax for managing this release.
0
57
106
This is why you can always upgrade @apachekafka in place without downtime.
The Kafka broker supports all protocols since AK 0.8 which was released 7 years ago. I think that's pretty darn impressive #builttolast.
0
21
103
Today’s Apache Kafka 3.1.0 release brings custom partitioners in foreign-key joins, FetchRequest support for topic IDs, SASL/OAUTHBEARER support for OIDC, new MirrorMaker configuration controls, and more! Read the key updates in @davidjacot's blog post:
2
51
98
From Kafka to Google BigQuery: A Guide for Streaming Billions of Daily Events
0
49
99
Great example of a large scale machine learning pipeline @Twitter built with @apachekafka as the pipeline and using Kafka Streams for data prep.
Read how the new streaming pipeline we built improves both latency and resiliency of Twitter’s home timeline prediction.
0
44
98
Step-by-step walk through of building a stream processing application using Kafka's streams API and @docker
0
50
102
It's upgrade time!. We are happy to announce that the 2.3.1 bug fix release is available now. For details check out the release notes:
4
44
97
Kafka in the top ten!.
1
27
97
Big day today! Two bug fix releases: 0.10.2.2 and 0.11.0.3. Thanks to release manager @MatthiasJSax!.Hurry up and upgrade - 28 bugs fixed, including 5 blockers.
0
41
100
I am getting old. glad to have you!. Happy Birthday @kafkastreams!.
Five years ago, @apachekafka 0.10.0.0 was released, marking my birthday. 14 releases and 120+ KIPs later, it’s time to celebrate!. Thanks to all contributors who made me what I am! \1.
1
20
100
KCache: Persistent, replicated caches backed by Kafka topics.
0
33
96
Kafka’s streams api supports pluggable, partitioned, fault tolerant data structures as state stores, which makes this type of local lookup structure really easy.
1
48
91
Architectures for crawling and indexing for search used to be primarily batch, but now are generally stream processing flows that transform and augment the data for indexing as it is collected.
0
15
95
Kafka clients now both forward and backwards compatible to make decoupled, no-downtime upgrades easier
2
78
92
Apache Kafka 2.5.1 was released! Thanks to all contributors and to our release manager John Roesler!. For details, check out the release notes:
0
31
89
PR from @xvrl speeds up the Java Kafka consumer on compressed messages. For 128 byte msgs & lz4 it's now 30x faster!
1
51
86
For stream processing using Kafka - Build apps, not clusters. Do Kappa, not Lambda. Here's how
0
59
82
Great introduction to Kafka's streams API and a comparison to RxJava
0
48
85
Capturing database changes and creating derived views using @debezium and Kafka's Streams API
0
32
77
We are happy to announce the Apache Kafka 2.2.2 bug-fix release. Thanks to everyone who contributed and to our release manager @rhauch!. For more details, check out the release notes:
1
28
78
Announcing the Kafka 0.10 release, includes Kafka Streams, event time, rack awareness, & 400 other fixes & features
1
110
78
We are happy to announce the Apache Kafka 2.6.1 bug fix release. It closes 41 Jiras. Thanks to all contributors and to our release manager @MickaelMaison!. For details, please check out the release notes:
0
16
79
Kafka!.
Everyone is missing the really important parts of Twitter algorithm :)
1
9
77
We are happy to announce John Roesler as new Apache Kafka committer! . Congratulations, John!.
1
4
73
Real Time Data Visualization With MongoDB, Kafka, D3.js, and Node.js
1
37
68
Tracking NYC Citi Bike real time utilization using Kafka Streams
0
33
69
We are happy to announce the Apache Kafka 3.1.1 bug fix release! It addressed 30 issues. Thanks to all contributors and to our release manager Tom Bentley. For details check out the release notes:
0
20
64
ThoughtWorks technology radar says to assess “Event streams as a source of truth” using @apachekafka
2
29
69
We are pleased to announce the Apache Kafka 3.4.0 release. Thanks to all 117 contributors and our RMs @BleeGoldman and David Arthur. An overview can be found in our announcement blog post:. For details checkout the release notes.:
0
24
67