Skip to content

Scoring implementation #433

@May0Mei

Description

@May0Mei

Hi, thanks for the cool project!

I'm trying to run the examples here:
https://github.com/google/langfun/blob/2ae17d3da30d54633fc93620e0316d7c08673aaa/langfun/core/structured/scoring.py#L43C1-L44C1
But the scoring functionality doesn't seem to have been implemented for specific lms, e.g.

scores = lf.score('{{x}} + {{y}} =', ['1', '2', '3'], lm=lf.llms.Gpt4o(), x=1, y=2)
# NotImplementedError: Gpt4o does not support scoring.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions