Skip to content

[SYSTEMDS-3779] Add ColGroupDDCLZW with LZW-compressed MapToData #2398

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
florian-jobs wants to merge 17 commits into
base: main
Choose a base branch
from
+1,995 −1,266
Open

[SYSTEMDS-3779] Add ColGroupDDCLZW with LZW-compressed MapToData #2398

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
ee9e94f
Second skeleton for ColGroupDDCLZW using the IMapToDataInterface and …
florian-jobs Jan 7, 2026
007611c
Idea:
florian-jobs Jan 8, 2026
b1bf906
More TODOS written and cleaned up project.
florian-jobs Jan 9, 2026
8027458
Dictionary initialisierung für Compress und rudimentäre Implementieru…
Jan 10, 2026
ef3b834
Uebersichtlichkeit verbessert
Jan 10, 2026
9886821
Minor error fixing. Redesigned compress method.
florian-jobs Jan 11, 2026
e0d5d75
Added red/write methods to serialize and deserialize from stream.
florian-jobs Jan 11, 2026
beb4613
Commented code, error handling for compress. next step make compress …
florian-jobs Jan 11, 2026
620e03a
Added first stages of tests. improved compression and decompression a…
florian-jobs Jan 11, 2026
b7911d7
Added convertToDDCLZW() method to ColGroupDDC Class. Added convertToD…
florian-jobs Jan 12, 2026
1dfe91e
Started working on ColGroupDDCLZW's other methods that need to be imp…
florian-jobs Jan 12, 2026
3156863
test commit
florian-jobs Jan 13, 2026
10d5776
[SYSTEMDS-3779] Added new Compression and ColGroup Types DDCLZW.
florian-jobs Jan 13, 2026
3c9e2ed
[SYSTEMDS-3779] Introduce initial ColGroupDDCLZW with LZW-compressed …
florian-jobs Jan 13, 2026
a8df1fe
Decompression to a specific index
Jan 15, 2026
96cb6e9
slice Rows
Jan 16, 2026
a30cc91
[SYSTEMDS-3779] Add imemdiate stop after index certain index in decom…
florian-jobs Jan 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions src/main/java/org/apache/sysds/runtime/compress/colgroup/AColGroup.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@ public abstract class AColGroup implements Serializable {

/** Public super types of compression ColGroups supported */
public static enum CompressionType {
UNCOMPRESSED, RLE, OLE, DDC, CONST, EMPTY, SDC, SDCFOR, DDCFOR, DeltaDDC, LinearFunctional;
UNCOMPRESSED, RLE, OLE, DDC, CONST, EMPTY, SDC, SDCFOR, DDCFOR, DeltaDDC, DDCLZW, LinearFunctional;

public boolean isDense() {
return this == DDC || this == CONST || this == DDCFOR || this == DDCFOR;
Expand All @@ -86,7 +86,7 @@ public boolean isSDC() {
* Protected such that outside the ColGroup package it should be unknown which specific subtype is used.
*/
protected static enum ColGroupType {
UNCOMPRESSED, RLE, OLE, DDC, CONST, EMPTY, SDC, SDCSingle, SDCSingleZeros, SDCZeros, SDCFOR, DDCFOR, DeltaDDC,
UNCOMPRESSED, RLE, OLE, DDC, CONST, EMPTY, SDC, SDCSingle, SDCSingleZeros, SDCZeros, SDCFOR, DDCFOR, DDCLZW, DeltaDDC,
LinearFunctional;
}

Expand Down
Loading