Redpanda Connect

Building an experience that wows users instantly is directly proportional to the effort placed by the builders at every turn, every commit. Not to mention hundreds of hours wasted using bad products to form strong opinions. The time it takes to create your first, globally-distributed cluster from sign up in…

Continue ReadingRedpanda Connect

How to detect fraudulent clicks in a real-time ad system

Fraud detection involves identifying fraudulent activities by analyzing patterns, behaviors, and anomalies in various types of data. Although to properly safeguard individuals, businesses, and financial institutions from fraudulent actions, it needs to happen as soon as the fraudulent activity occurs — in real time. Fraud detection can be broadly classified into…

Continue ReadingHow to detect fraudulent clicks in a real-time ad system

How to build a scalable platform architecture for real-time data

The Software as a Service (SaaS) industry is showing unstoppable growth, with a projected $317.55 billion market size in 2024 almost quadrupling to $1,228.87 billion by 2032. This expansion highlights the growing need for enhanced and robust data strategies. This trend is propelled by the increasing volume, velocity and variety…

Continue ReadingHow to build a scalable platform architecture for real-time data

Capture and move sales data to BigQuery with Redpanda and Flink

Change data capture (CDC) is a process that identifies and captures the changes made to the data in a database. It can identify the added, updated, or deleted records in a database and move those changes to different storage systems, including data warehouses, caches, and search indexes, to support different…

Continue ReadingCapture and move sales data to BigQuery with Redpanda and Flink

Last value cache: the no-code way with Redpanda Data Transforms

In Pub/Sub messaging systems, last value caching (LVC) is a common technique that allows new subscribers to quickly catch up to the latest state of the world. Imagine a stock ticker app that shows the current price for one or more symbols. When a new instance of the app starts…

Continue ReadingLast value cache: the no-code way with Redpanda Data Transforms

Redpanda 24.1 introduces write caching to turbocharge performance

The 24.1 release of Redpanda's streaming engine is arriving fast and furious, adding a write caching option for even better performance. It also brings the general availability of Data Transforms to users of Redpanda Community Edition and Redpanda Enterprise. Plus, Enterprise users get simplified permissions management with Role-Based Access Control…

Continue ReadingRedpanda 24.1 introduces write caching to turbocharge performance

Real-time brand sentiment analysis with ClickHouse and Redpanda

Collecting, processing, and reacting to customer reviews in real time is crucial for brands. Firstly, it allows them to immediately identify and address issues for improved customer satisfaction. Secondly, it provides them with continuous feedback, which can be used to improve products or services. Lastly, it enables them to stay…

Continue ReadingReal-time brand sentiment analysis with ClickHouse and Redpanda

Understanding the Redpanda Data Transform architecture

Around 60% of stream processing is spent on mundane transformation tasks. Format unification for machine learning (ML) workloads, filtering for privacy, simple enrichments like geo-IP translations — the list goes on. To stand up something “simple” often involves three or four distributed systems, multiple nights of reading configurations, and a…

Continue ReadingUnderstanding the Redpanda Data Transform architecture

Deploy a scalable ad analytics system in the cloud with Amazon Redshift and Redpanda

Businesses running large-scale advertising campaigns need to analyze ad performance data as quickly as possible. Amazon Redshift, Amazon's fully managed petabyte-scale data warehouse, is a popular option as it enables the ingestion and processing of vast amounts of streaming ad event data in real time. Redshift is a fast, scalable,…

Continue ReadingDeploy a scalable ad analytics system in the cloud with Amazon Redshift and Redpanda