Extremely high memory usage

[kiki-i]

I had used PicoscenesToolbox to parse 400K packets of raw CSI data. It cost 64 GiB memory usage.

Is it necessary for parsing numerous packets? Or maybe there is memory leakage.

[Herrtian]

I think something i write wrong,i will check it whether there is a memory leakage

…

------------------ 原始邮件 ------------------ 发件人: ***@***.***>; 发送时间: 2023年12月2日(星期六) 中午12:15 收件人: ***@***.***>; 抄送: ***@***.***>; 主题: [Herrtian/PicoscenesToolbox] Extremely high memory usage (Issue #4) I had used PicoscenesToolbox to parse 40K packets of raw CSI data. It cost 64 GiB memory usage. Is it necessary for parsing numerous packets? Or maybe there is memory leakage. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[kiki-i]

I think it cause by reading the entire .csi file into memory at once. Use the generator to read file on demand should significantly reduce memory usage.

[kiki-i]

I developed PicoScenesParser.py to address this issue. It utilizes a dynamic link library (libpico) to offer a more Pythonic experience compared to Cython.

I think it cause by reading the entire .csi file into memory at once. Use the generator to read file on demand should significantly reduce memory usage.