Pretranslation API

[functionzz]

Description

This PR implements a Pretranslation API at api/v2/pretranslate/?format_string=FORMAT&locale=CODE. It utilizes existing pretranslation functionality in Pontoon and extends it as an authenticated service for those who need a pretranslation from either Translation Memory or AutoML.

Fixes #3830.

Additional Notes

Authentication for this endpoint is temporarily disabled for easier testing
Requires some testing on android and gettext resource formats.

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 78.85%. Comparing base (737a932) to head (e8593da).

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[mathjazz]

Nice work! Left some comments inline.

[functionzz]

I also applied the same above env change for PRETRANSLATION_API_MAX_CHARS to the PERSONAL_ACCESS_TOKEN configuration if that is something that we want.

[mathjazz]

The code looks good!

Why is the PR maked as Draft? Is there any functionality still missing?

[mathjazz]

I wonder if we should also check if Locale.google_automl_model is set. That way Pretranslation API will only work for locales for which Pretranslation in Pontoon works, i.e. for the ones that have custom MT models.

@flodolo Thoughts?

[mathjazz]

You can test the PR on https://mozilla-pontoon-staging.herokuapp.com:

import requests

response = requests.post(
    "https://mozilla-pontoon-staging.herokuapp.com/api/v2/pretranslate/?locale=sl",
    data="Open",
    headers={
        "Content-Type": "text/plain",
        "Accept": "application/json",
        "Authorization": f"Bearer {TOKEN}",
    },
)

[mathjazz]

Please add a flag in the UserProfile model or create a user group for users authorized to use pretranslation, and use that as another authentication step.

[flodolo]

You can test the PR on mozilla-pontoon-staging.herokuapp.com:

import requests

response = requests.post(
    "https://mozilla-pontoon-staging.herokuapp.com/api/v2/pretranslate/?locale=sl",
    data="Open",
    headers={
        "Content-Type": "text/plain",
        "Accept": "application/json",
        "Authorization": f"Bearer {TOKEN}",
    },
)

Noting that this works on Heroku, but not on GCP (CSRF validation fails).

[flodolo]

This is the error displayed if we're missing the Google API keys. We probably need to fix this.

{"error":"An error occurred: Pretranslation for `test = { -brand-short-name } says:` to it not available.. Please verify the resource format and syntax."}