Tag: Kafka
Real-Time Data Streaming, Kafka and Analytics, Part 2: Going Beyond Pure Streaming
Data transaction streaming is managed through many platforms, with one of the most common being Apache Kafka. In our first article in this data streaming series, we delved into the definition of data transaction and stre Read more…
Real-Time Data Streaming, Kafka, and Analytics Part One: Data Streaming 101
The terms “real-time data” and “streaming data” are the latest catch phrases being bandied about by almost every data vendor and company. Everyone wants the world to know that they have access to and are using th Read more…
Top 12 Datanami Stories of 2019
2019 was an eventful year in the big data space, with enough intersecting story lines to keep a big data watcher enmeshed for hours – if not days -- on end. We did our best to trace the story lines out for you, dear re Read more…
Confluent Reveals ksqlDB, a Streaming Database Built on Kafka
Confluent narrowed the distance separating Kafka-esque stream data processing and traditional database technology with today’s unveiling of ksqlDB, a new database built atop Kafka that the company intends to be the fut Read more…
Kafka Transforming Into ‘Event Streaming Database’
Don't look now, but Kafka is transforming into a database. That's the new direction the popular event streaming platform is headed, according to Confluent CEO Jay Kreps keynote this morning, in which he gave a glimpse in Read more…
Neo4j Gets Hooks Into Kafka
Today at the Kafka Summit, Neo4j unveiled a new product called Neo4j Streams that will make it easier to connect streaming data from Apache Kafka with the company's graph database. Analytics use cases, such as financial Read more…
When Not to Use a Database, As Told by Jun Rao
Databases are powerful abstractions that allow people and programs to manipulate large amounts of data in a predictable, repeatable way. There's a good reason why SQL is so important to modern data processing. But in som Read more…
Kafka Spawns Open-Source KarelDB
Apache Kafka and its accompanying key-value store are being used to provide persistent storage for a growing list of relational databases. Most used a key-value store as a foundation. Among the latest to emerge is Kar Read more…
Rockset Connects Kafka with SQL
Rockset, the serverless search and analytics startup, is extending the ability to run SQL on NoSQL data with real-time event analysis on Apache Kafka. The company, based in San Mateo, Calif., said it is coming at the Read more…
LinkedIn Unleashes ‘Nearline’ Data Streaming
LinkedIn is releasing its Brooklin data ingestion service to the open source community. Brooklin has been running in production on the social media platform since 2016. The stateless and distributed service is used pr Read more…
Cassandra, Kafka Help Scale Anomaly Detection
The scaling of open-source platforms continues apace with the demonstration of an anomaly detection application capable of processing tens of billions of events per day using Apache Cassandra and Apache Kafka running on Read more…
What’s Behind Lyft’s Choices in Big Data Tech
Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually gave Lyft a bit of a Read more…
Real-Time Streaming for ML Usage Jumps 5X, Study Says
A new survey sponsored by Lightbend found that implementations of real-time stream data processing systems for machine learning and AI applications jumped by 500% over the past two years. It also found that Kafka is almo Read more…
Data Engineering Continues to Move the Employment Needle
Interested in a career in big data? You could do well by investing your time and effort in acquiring data science skills. But you may do even better by turning yourself into a data engineer, which is a title that continu Read more…
Want Kafka on Kubernetes? Confluent Has It Made
If the idea of streaming massive amounts of data on a virtual server platform that spans public cloud and on-premise clusters piques your interest, you're not alone. Many organizations have attempted to wire Apache Kafka Read more…
Confluent Adds KSQL Support to Kafka Platform
The latest version of Confluent’s Kafka-based platform incorporates an open source streaming engine for Apache Kafka designed to allow developers using SQL to build real-time, streaming applications. Confluent, the Read more…
Streamlio Claims Pulsar Performance Advantages Over Kafka
Streamlio, a startup created a real-time streaming analytics platform on top of Apache Pulsar and Apache Heron, today published results of stream processing benchmark that claims Pulsar has up to a 150% performance impro Read more…
Weighing Open Source’s Worth for the Future of Big Data
The open source software movement began in earnest 20 years ago, when a group of technology leaders in Silicon Valley coined the term as an alternative to the repugnant "free software." Fast forward to 2018, and the conc Read more…
DataTorrent Glues Open Source Componentry with ‘Apoxi’
Building an enterprise-grade big data application with open source components is not easy. Anybody who has worked with Apache Hadoop ecosystem technology can tell you that. But the folks at DataTorrent say they've found Read more…
Fueled by Kafka, Stream Processing Poised for Growth
Once a niche technique used only by the largest organizations, stream processing is emerging as legitimate technique for dealing with massive amounts of data generated every day. While it's not needed for every data chal Read more…
Leading Solution Providers
Tabor Network
