Skip to content

Conversation

@NeoZ666
Copy link

@NeoZ666 NeoZ666 commented Jul 16, 2024

fix: Correct TokenGazetteer and Tokenizer initialization and data formatting

  • Updated the initialization of TokenGazetteer and NLTKTokenizer to use the correct parameters.
  • Added comment for explanation.
  • Ensured compatibility with the updated API parameters.

This fixes the issue where incorrect parameters were causing errors during the initialization of TokenGazetteer, NLTKTokenizer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant