Skip to content

feat(cubestore): Add Azure Blob Storage support for remote filesystem#10573

Open
tete17 wants to merge 2 commits intocube-js:masterfrom
tete17:feat/cubestore-azure-blob-storage
Open

feat(cubestore): Add Azure Blob Storage support for remote filesystem#10573
tete17 wants to merge 2 commits intocube-js:masterfrom
tete17:feat/cubestore-azure-blob-storage

Conversation

@tete17
Copy link
Copy Markdown

@tete17 tete17 commented Mar 27, 2026

Issue Reference

Resolves #10332
Resolves #8288

Description of Changes Made

Add Azure Blob Storage as a remote filesystem backend for Cube Store, supporting multiple authentication methods:

  • Account key: via CUBESTORE_AZURE_ACCESS_KEY
  • SAS token: via CUBESTORE_AZURE_SAS_TOKEN
  • DefaultAzureCredential: automatic fallback for workload identity, managed identity, and Azure CLI — no extra Cube Store env vars needed, uses standard AZURE_* variables

Implementation

  • New AzureBlobRemoteFs struct implementing RemoteFs and ExtendedRemoteFs traits
  • Uses the object_store crate (already a dependency) with the azure feature enabled
  • FileStoreProvider::AzureBlob variant added to config with CUBESTORE_AZURE_CONTAINER and CUBESTORE_AZURE_ACCOUNT as required env vars
  • No credential refresh loop needed — the azure_identity crate handles token lifecycle internally
  • Telemetry instrumented with driver:azure_blob tags

Environment Variables

Variable Required Description
CUBESTORE_AZURE_CONTAINER Yes Blob container name (activates Azure backend)
CUBESTORE_AZURE_ACCOUNT Yes Storage account name
CUBESTORE_AZURE_ACCESS_KEY No Account access key
CUBESTORE_AZURE_SAS_TOKEN No SAS token
CUBESTORE_AZURE_SUB_PATH No Path prefix within the container
CUBESTORE_AZURE_ENDPOINT No Custom endpoint (Azurite, sovereign clouds)

Check List

  • Tests have been run in packages where changes have been made if available
  • Linter has been run for changed code
  • Tests for the changes have been added if not covered yet
  • Docs have been added / updated if required

tete17 added 2 commits March 27, 2026 19:56
Implement AzureBlobRemoteFs with support for multiple authentication
methods: account key, SAS token, and DefaultAzureCredential (workload
identity, managed identity, Azure CLI).
Document CUBESTORE_AZURE_* environment variables in all three env var
reference files and add Azure Blob Storage docker-compose examples and
DefaultAzureCredential section to running-in-production guides.
@tete17 tete17 requested a review from a team as a code owner March 27, 2026 19:01
@github-actions github-actions bot added cube store Issues relating to Cube Store rust Pull requests that update Rust code pr:community Contribution from Cube.js community members. labels Mar 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cube store Issues relating to Cube Store pr:community Contribution from Cube.js community members. rust Pull requests that update Rust code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Want to use azure blob storage as external preaggregation storage Does Cube Core support Azure Blob Storage?

1 participant