Whether you are on-prem or in the Cloud, you want to ensure you set up your tools and processes in a homogenous way. No matter where the infrastructure is being accessed you want to ensure the tools used to interact with the various pieces of infrastructure are similar to the…
Snowflake's support for external tables has seen significant updates since our last blog post on how to extend your Snowflake implementation with MinIO. External tables allow users of Snowflake to treat data in object storage like MinIO as a read-only table in Snowflake without migration. Snowflake's ongoing enhancements to their…
Data processing is a fundamental practice in modern software development. It enables teams to automate the collection, processing, and storage of data, ensuring high-quality data and efficient handling. In this article, we will explore how to set up a comprehensive data processing pipeline that highlights the use of the Tailscale…
Keycloak is a Single-Sign On solution. Using Keycloak users authenticate with Keycloak rather than MinIO. Without Keycloak you would have to create a separate identity for each user - that would be cumbersome to manage in the long run. You would want a central identity solution to manage authentication and…
What has become clear over the past couple of years is that the public cloud, for all of its benefits, doesn't deliver cost savings at scale. It delivers productivity gains, to a point, but it will not reduce your costs. There is goodness in the public cloud as it offers…
As a Snowflake user, you're likely familiar with its strengths in managing data in collaborative environments. The user experience of Snowflake is often praised for its intuitive interface and seamless integration capabilities. Snowflake's ability to handle diverse data workloads, from simple queries to complex data processing tasks, makes it an…
Dell ECS clusters allow you to migrate your data to any S3 compatible store. Dell ECS calls this feature “Data Movement”, also called copy-to-cloud. It's a feature introduced in ECS 3.8.0.1 that allows you to copy objects from Dell ECS to MinIO which is rather popular with customers and prospects…
A table format for batch and stream processing, Apache Paimon has graduated from the Apache Incubator Wilmington, DE, April 16, 2024 – The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 320 active open source projects and initiatives, today announced that Apache Paimon has graduated…
Can you tell us a bit about the project?Apache A Graph Extension (AGE) is a PostgreSQL extension that provides graph database functionality. The project was originally developed in 2019 as an extension to AgensGraph, Bitnine Global’s multi-model database fork of PostgreSQL. Apache AGE entered the Apache Incubator in April 2020…
The intermediate data service for big data computing engines has graduated from incubation Wilmington, DE, April 23, 2024 – The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 320 active open source projects and initiatives, today announced Apache Celeborn has graduated from incubation and is…