Elasticsearch is a scalable, multitenant-capable, full-text, distributed search and analytics engine. It's built on Apache Lucene, a high-performance text search engine library, and is open source. Elasticsearch is a document-based database used for various applications, including analytics, search, and monitoring. Meanwhile, Apache Flink® is an open-source platform for distributed stream…
At Redpanda, we know that changing the future of streaming data needs a community, but building a strong community starts with us. That’s why once a year we call in the Redpanda pack from around the world to meet, learn, build, and get inspired at our company kick-off (CKO). This…
The latest release of Redpanda Cloud adds enterprise security features and expands on performance with additional high-throughput tiers — with up to 1.2 GBps ingress — while still delivering lower TCO for customers like ShareChat. Additionally, we're upgrading our uptime SLA to 99.95% (or "three nines five" availability) and expanding…
The manufacturing landscape has evolved beyond recognition since the Industrial Revolution. Back in the day, those with the most manpower or the largest fleet of machines owned the lion’s share of the market. Fast forward to today, machines are no longer the center of attention in manufacturing — but the…
In today's digital age, the ability to process and analyze clickstream data in real time is a game-changer for businesses. The insights derived from this data can help businesses understand user behavior, optimize their websites, and deliver personalized user experiences. However, building a system that can handle the volume and…
With the recent announcement of Redpanda 23.3, users can now embed stateless data transformations right into the heart of Redpanda using Data Transforms powered by WebAssembly (Wasm). There are many use cases for this, including format transcoding, validation and verification, filtering, and redaction of sensitive information. In this post, we…
In the realm of streaming data, simplicity and efficiency can be elusive. Managing clusters often involves handling various tools, which in turn creates a complex and time-consuming nightmare. Our engineers know the pain all too well, so they built rpk—Redpanda's dev-friendly, all-in-one command-line tool that makes developers’ jobs easier. The…
Apache Flink® is a powerful framework that facilitates the seamless processing of massive amounts of data with low latency. Flink is a vital component of many streaming data systems and is also a versatile tool for many use cases, including fraud detection, rule-based alerting, anomaly detection, real-time IoT monitoring, traffic…
A new year, a new Redpanda! Right before the New Year’s ball dropped, we rolled out the latest major version of Redpanda, 23.3. This release includes Redpanda Data Transforms in beta, significant boosts to enterprise security and compliance (OIDC/SSO support, audit logging), reliability (whole cluster restore, recovery mode, fast commission/decommission),…
Moving to another streaming data platform is not a decision that’s made lightly, but it’s one many companies are now making to achieve higher throughput, minimal latency operations, and a significantly lower total cost of ownership. There are many flavors of Kafka implementations—a popular one being Amazon Managed Streaming for…