Recent searches
Search options
#apachekafka
Why Was Apache Kafka Created?
#Error Handling #Patterns for #ApacheKafka Applications
https://www.confluent.io/blog/error-handling-patterns-in-kafka/
What’s the difference between SSDs and Object Storage? Latency, redundancy and $$$$! Plus a lot of deeply technical work if you want the flexibility to choose.
This week I’m joined by Filip & Josep of Aiven, talking about adapting #ApacheKafka to write straight to S3:
Apache Kafka’s tiered storage unlocks massive scalability and long-term data retention without breaking the bank. Watch Paul Brebner explain how it works, its impact on performance and cost, and real-world replay use cases at #FOSSASIASummit2025
Watch: https://youtu.be/Sz8qtxAuL_Y
#Kafka 4.0 is out with a slew of new features and enhancements!
Notably, it introduces default operation in KRaft mode, eliminating Apache ZooKeeper dependencies.
Dive deeper into the updates on #InfoQ 
https://bit.ly/429ZfuH
Join the Apache Kafka x Apache Pinot meetup hosted by VirtusLab and featuring @adamwarski
The event will take place on November 26th from 6:00 p.m. to 8:00 p.m. in Kraków. Register here: https://www.meetup.com/krakow-kafka/events/304395169/?eventOrigin=group_events_list
This role will let me build on my recent work, dive into new tech, and support the next wave of #openSource innovation. While I may be shifting gears, I’m looking forward to continued collaboration with the wonderful #apacheKafka 
and #apacheFlink 
communities.
The October issue of #CheckpointChronicle is now out 
It covers Ververica's Fluss, #ApacheFlink 2.0, Iggy.rs, Strimzi's support for #ApacheKafka 4.0, tons of OTF material from @vanlightly, Christian Hollinger's write up of ngrok's data platform, nice detail of how SmartNews use #ApacheIceberg with Flink and #ApacheSpark, a good writeup from Sudhendu Pandey on #ApachePolaris, notes from Kir Titievsky on Kafka's Avro serialisers, and much more!
I am only an infrequent visitor to LinkedIn, but today I discovered a valuable tip from @gunnarmorling about the new Kafka Native Docker image. Thank you!
I was writing some #Python code to grab event data from Github when I realised it was the perfect project to dive into some fundamentals for performance-tuning #ApacheKafka producers.
Let's code, tune, and say the magic words, "It depends."
Can you connect output from your COBOL copybooks to @ApacheKafka?
You can now 
"IBM® Open Enterprise SDK for Apache Kafka® is a no-charge SDK that allows COBOL or C/C++ code running on z/OS® to natively communicate with a Kafka broker and to transform between COBOL copybooks and JSON events." #ApacheKafka
See, I told you lots of familiar distributed tech is landing in the #mainframe world!
https://www.ibm.com/products/open-enterprise-sdk-kafka-apache #IBMZ #zOS
I've always thought it would be fun to use #ApacheKafka to drive a live-updating spreadsheet. Kafka for handling the data, spreadsheets for exploring it.
(Plus, you can always make friends in a company if you're the programmer who can get that data into the non-programmers' favourite programming language. 
)
Thanks to Quix I got to build it and film a walkthrough. 
My first blog post on the @honeycombio company blog was published today about an interesting situation we ran into when using Confluent's tiered storage feature on our brokers: https://www.honeycomb.io/blog/investigating-kafka-tiered-storage #Kafka #ApacheKafka #PlatformEngineering #DevOps
Last year I wrote about using #ApacheKafka with #ngrok, and was chuffed how easily it worked.
Yesterday I went to use it for a forthcoming blog…and it didn't work.
After much gnashing of teeth and a fair bit of swearing, I got it to work. The culprit? DNS. Always DNS…
“What are we going to be talking about? We're going to be talking about how we built this scalable, high-throughput timer system at OneSignal. We're going to be talking about the motivation behind building it, in the first place. The architecture of the system itself. How the system performed. How we scaled it up, and some future work that we are maybe thinking about doing in the system.” Lily Mara & Hunter Laine at #QConSF
Watch the #InfoQ video with #transcript & Q&A included: https://bit.ly/4djqAxV
Allegro experimented with different performance optimization options to improve #ApacheKafka producer tail latency and eventually switched all its clusters to the XFS filesystem.
How
Dive into the #CaseStudy via #InfoQ: https://bit.ly/44jyyD3
Using #apacheKafka? Got opinions on hosting it yourself or got a favourite (or worst!) cloud provider? Join in the thread: https://www.reddit.com/r/apachekafka/comments/1c7uqce/question_whats_the_state_of_kafka_hosting_in_2024/
(if you work for a cloud provider, you *must* disclose that if you contribute; no astroturfing or FUD!!)
