Skip to content

First implementation of a VLArray store#602

Merged
FrancescAlted merged 7 commits intomainfrom
vlarray
Mar 15, 2026
Merged

First implementation of a VLArray store#602
FrancescAlted merged 7 commits intomainfrom
vlarray

Conversation

@FrancescAlted
Copy link
Member

@FrancescAlted FrancescAlted commented Mar 14, 2026

VLArray is a wrapper around one SChunk, with one logical entry per physical chunk.

Entries are:

  • serialized with msgpack
  • compressed before being stored
  • decompressed and deserialized on retrieval

Supported value types are:

  • bytes
  • str
  • int
  • float
  • bool
  • None
  • list
  • tuple
  • dict

The implementation also required a prerequisite fix in the sibling c-blosc2 repository so a single SChunk can hold variable-sized chunks across multiple chunks, not just a smaller last chunk.

@FrancescAlted FrancescAlted merged commit 920a6f7 into main Mar 15, 2026
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant