We are pleased to announce that RabbitMQ 4.0 supports AMQP 1.0 as a core protocol, providing the following benefits: Modernized RabbitMQ to natively support the latest AMQP standard Support for more AMQP 1.0 features Significantly better AMQP 1.0 performance and scalability compared to RabbitMQ 3.13 Greater interoperability with other AMQP…
The team at Insight Partners just released their State of Enterprise Tech report for 2024. There is a lot to consume in the 60+ slides, but we cherry picked the things that should be interesting to our audience - and frankly there is a lot of interesting stuff. I will leave…
The modern enterprise defines itself by its data. This requires a data infrastructure for AI/ML as well as a data infrastructure that is the foundation for a Modern Datalake capable of supporting business intelligence, data analytics, and data science. This is true if they are behind, getting started or using…
The concept of open source has become a universally accepted development model since its beginnings over a quarter-century ago. That statement was never realized more than walking into the United Nations headquarters earlier this month to attend the second “OSPOs for Good” event. Open source had indeed arrived. Policymaking and…
co-author: Kaiming WanApache Kafka is the de facto standard in streaming due to its excellent design and powerful capabilities. Not only has it defined the architecture of modern streaming, but its unique distributed log abstraction has also provided unprecedented capabilities for real-time data stream processing and analysis. Kafka's success lies…
An embedding subsystem is one of four subsystems needed to implement Retrieval Augmented Generation. It turns your custom corpus into a database of vectors that can be searched for semantic meaning. The other subsystems are the data pipeline for creating your custom corpus, the retriever for querying the vector database…
Open table formats like Apache Iceberg, Apache Hudi, and Delta Lake have become the de facto standard for query processors. However, recent news of the adoption of Iceberg’s REST Catalog API by query engines like Snowflake and Databricks has shifted the playing field in favor of Iceberg.Iceberg's success stems not…
In an Apache Kafka® cluster, Apache ZooKeeper™ is a centralized service that enables Kafka brokers, producers, and consumers to form a coherent distributed system. It maintains the cluster metadata, elects leaders, and facilitates coordination among various Kafka components. However, the Apache Kafka community began deprecating and removing ZooKeeper dependency around…
In a modern datalake, catalogs serve as the backbone for organizing and querying data efficiently. Recent news stories, including Databricks’s acquisition of Tabular and Snowflake’s open-sourcing of Polaris, have given catalogs an "it" moment. However, the industry is at a crossroads, with diverse implementations creating a fragmented ecosystem. What can…
Observability is all about gathering information (traces, logs, metrics) with the goal of improving performance, reliability, and availability. Seldom does just one of these pinpoint the root cause of an event. More often than not, it's when we correlate this information to form a narrative is when we’ll have a…