Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

Implement PII#846

Closed
lukehinds wants to merge 1 commit intomainfrom
pipeline-pii
Closed

Implement PII#846
lukehinds wants to merge 1 commit intomainfrom
pipeline-pii

Conversation

@lukehinds
Copy link

Implementation of story #394

We use SPacy Industrial-strength Natural Language Processing (NLP) model and the Presidio to discover PII within code snippets and chat completions

Note this is WIP staged early to allow UI work to start

There are still some issues specific to CoPilot I need to fix along with improving the delivery mechanisms (pulling down the spacy model)

# TODO: Might want to check these with James!
notification_text = (
f"🛡️ [CodeGate protected {redacted_count} instances of PII, including {pii_summary}]"
f"(http://localhost:9090/?search=codegate-pii) from being leaked "
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like this. It looks like we'll prob go with ?view=pii — but I can confirm when this it's set up in the frontend, and come back to tweak it if necessary.

Implementation of story #394

We use SPacy Industrial-strength Natural Language Processing (NLP) model
and the Presidio to discover PII within code snippets and chat
completions

Note this is WIP staged early to allow UI work to start

There are still some issues specific to CoPilot I need to fix
along with improving the delivery mechanisms (pulling down the spacy
model)
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants