Stream names are being truncated by _NeoBaseExtractor

[bparks13]

The following data is recorded using the ONIX Source plugin from the Open Ephys GUI.

When loading data using the open-ephys-python-tools, the following stream names are displayed:

ONIX_Source-100.BreakoutBoard-AnalogIO-AnalogInput/
ONIX_Source-100.BreakoutBoard-MemoryMonitor-PercentUsed/
ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-Probe-AP/
ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-Probe-LFP/
ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-BNO055/

However, when loading the same data using the SpikeInterface read_openephys extractor, the following stream names are displayed:

Stream 0 | Record Node 103#ONIX_Source-100.BreakoutBoard-AnalogIO-AnalogInp
Stream 1 | Record Node 103#ONIX_Source-100.BreakoutBoard-MemoryMonitor-Perc
Stream 2 | Record Node 103#ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-B
Stream 3 | Record Node 103#ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-P
Stream 4 | Record Node 103#ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-P

The stream_name variable in SpikeInterface is truncating the stream name. This appears to be coming from the _NeoBaseExtractor.get_streams method, and affects loading data when trying to set either the stream_name or the stream_id; the stream_name is the same for both streams, and the stream_id pulls from the stream_name variable, which ends up loading the same data when trying to load stream 3 or stream 4 above.

[chrishalcrow]

Hello, problem is here:

https://github.com/NeuralEnsemble/python-neo/blob/a376b4a74e1ee186a75fb4d357052ed4518c846d/neo/rawio/baserawio.py#L106

EDIT: or somewhere near here!!!

The name of a stream in neo is capped at 64 characters long. Could you raise an issue there?

[alejoe91]

good catch Chris!!! We should increase the size!

[bparks13]

@chrishalcrow After testing, I was able to get the stream name to stop truncating by changing this line instead to U128:

https://github.com/NeuralEnsemble/python-neo/blob/a376b4a74e1ee186a75fb4d357052ed4518c846d/neo/rawio/baserawio.py#L97

Below is the new output:

Stream 0 | Record Node 103#ONIX_Source-100.BreakoutBoard-AnalogIO-AnalogInput | 12 ch | 25000.0 Hz | 4721425 samples
Stream 1 | Record Node 103#ONIX_Source-100.BreakoutBoard-MemoryMonitor-PercentUsed | 1 ch | 100.0 Hz | 18890 samples
Stream 2 | Record Node 103#ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-BNO055 | 18 ch | 100.0 Hz | 18930 samples
Stream 3 | Record Node 103#ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-Probe-AP | 384 ch | 30000.0 Hz | 5677344 samples
Stream 4 | Record Node 103#ONIX_Source-100.PortA-Neuropixels1.0eHeadstage-Probe-LFP | 384 ch | 2500.0 Hz | 473112 samples

[chrishalcrow]

Hello, this was merged into neo (NeuralEnsemble/python-neo#1802). So should work if you install neo from github.