Full refactor of the library#16

Merged

micedre merged 69 commits intomainfrom

Nov 20, 2025

Commits on Oct 22, 2025

Commits on Oct 31, 2025

Commits on Nov 3, 2025

Commits on Nov 4, 2025

feat!(components): first working example with full modularity
meilame-tayebjee
committed

Commits on Nov 5, 2025

Commits on Nov 7, 2025

Commits on Nov 10, 2025

fix: typo in trainer_params max_epochs

meilame-tayebjee
and
micedre
authored
feat!(tokenizer): ensure output is consistent across al tokenizers
meilame-tayebjee
committed
fix: move hf-dep to optional dependencies
meilame-tayebjee
committed
Merge branch 'main' into hf_tokenizer
meilame-tayebjee
authored
feat!(attention): enable attention logic
meilame-tayebjee
committed
fix: check if categorical var are present before checking their arrays

meilame-tayebjee
and
micedre
committed
fix: no persistent_workers if num_workers=0

meilame-tayebjee
and
micedre
authored

Commits on Nov 12, 2025

Commits on Nov 17, 2025

refactor: replace cpu_run with accelerator in TrainingConfig
meilame-tayebjee
committed

Commits on Nov 18, 2025

feat!(tokenizer-ngram): add very fast ngram tokenizer
meilame-tayebjee
committed

Commits on Nov 19, 2025

Commits on Nov 20, 2025