Seeing "ScratchInUseError('error code -10')" when run hyperscan

[YuehanZong]

Hi team,

We are running following code to scan the text extracted from files, and getting this ScratchInUseError('error code -10'):

# Initialize db at the beginning only once.
db = hyperscan.Database()
db.compile(expressions=expressions, ids=ids, elements=len(patterns), flags=flags)

# Been called every time there's new file coming
hs_context = {"results": []}
db.scan(text, match_event_handler=self._on_match, context=hs_context)

The database is initialized only once at the beginning, and each time we encountered a file we call db.scan() method for hyperscan.

Wondering if there's a way to explicitly create new scratch space every time before we call db.scan(), and also free-up the space after scan completed? Thanks

[darvid]

apologies for the delay.

i'll try to reproduce but are you by chance running scan multithreaded with a shared db? that error seems strange given the sample code. from the hyperscan docs:

HS_SCRATCH_IN_USE

    The scratch region was already in use.

    This error is returned when Hyperscan is able to detect that the scratch region given is already in use by another Hyperscan API call.

    A separate scratch region, allocated with hs_alloc_scratch(), is required for every concurrent caller of the Hyperscan API.

    For example, this error might be returned when hs_scan has been called inside a callback delivered by a currently-executing hs_scan call using the same scratch region.

    Note: Not all concurrent uses of scratch regions may be detected. This error is intended as a best-effort debugging tool, not a guarantee.

either way, db.scan should take a scratch parameter that you should be able to use