Where is the Complexity?

Text Size 100%: - + One of the common arguments I hear about avoiding XA distributed transactions is due to their complexity.  In this series of blog posts I’ll examine that claim by looking at three versions of the same application.  The first version of the application ignores data consistency…

Continue ReadingWhere is the Complexity?

Real-time predictions for ML apps with Redpanda Data Transforms

In the world of machine learning, change is the only constant. The traditional reliance on large, batch-processed datasets is giving way to a more dynamic, real-time data approach. This evolution is driven by the understanding that the ability to process and analyze data in real time is not just an…

Continue ReadingReal-time predictions for ML apps with Redpanda Data Transforms

Discover PasskeyIndex.io: Your Community Hub for Passkeys

Blog Discover PasskeyIndex.io: Your Community Hub for Passkeys Are you looking for a list of sites and platforms that support seamless authentication via passkeys? PasskeyIndex.io is a community-driven platform dedicated to collecting and organizing a list of services that are passkey-enabled. From platforms to websites to developer tools and more,…

Continue ReadingDiscover PasskeyIndex.io: Your Community Hub for Passkeys

Proper SQL comes to MongoDB applications .. with the Oracle Database!

Text Size 100%: - + As some of you might know, an exciting part of my job is working with the Oracle Database API for MongoDB (short MongoDB API), a part of Oracle's converged database that brings MongoDB's document store API to the world's best database (personal opinion, no need…

Continue ReadingProper SQL comes to MongoDB applications .. with the Oracle Database!

Architectural considerations for high-volume streaming data on GCP

Streaming data plays a pivotal role in applications and industries where real-time information powers monitoring and analysis in high-stakes industries like finance, healthcare, manufacturing, e-commerce, and other data-driven businesses. Cloud platforms, especially Google Cloud Platform (GCP), excel at processing and analyzing vast, fast-growing data. GCP's scalability, cost-effectiveness, managed services, global…

Continue ReadingArchitectural considerations for high-volume streaming data on GCP

How we Built a 19 PiB Logging Platform with ClickHouse and Saved Millions

Table of Contents # Introduction Choosing ClickHouse The scale of the problem ClickHouse Cloud infrastructure Building on top of ClickHouse Cloud Understanding your users Some early design decisions Choosing OpenTelemetry (OTel) Architectural overview Ingest processing Schema Enhancing Grafana Cross-region querying Performance and cost Looking forward Conclusion Introduction # We believe…

Continue ReadingHow we Built a 19 PiB Logging Platform with ClickHouse and Saved Millions