Empty data handling

[Gautzilla]

Right now, we have to manually filter out empty data from core datastes:

ads = AudioDataset(...)
ads.data = [data for data in ads.data if not data.is_empty]

Maybe we should implement a new version of the feature that existed in the legacy OSEkit, with a threshold of emptiness under which the data is rejected, which would be set to 0 by default?

ads = AudioDataset(..., data_emptniess_threshold = .05) # All AudioData that are 95% empty or more are rejected

The old behaviour of keeping empty data could be enforced by passing None to this parameter or whatever.

Also add trim functions that remove the empty items of data that are located on the sides? It seems like it's something that could be used regularly.

What do you think @mathieudpnt?

[mathieudpnt]

Maybe we should implement a new version of the feature that existed in the legacy OSEkit, with a threshold of emptiness under which the data is rejected, which would be set to 0 by default?

Sounds good to me however i would like to keep track of data segments that have been dismissed, maybe in the log ?

Also add trim functions that remove the empty items of data that are located on the sides? It seems like it's something that could be used regularly.

Yes why not if that is something that user find useful !