Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(generative_ai): clean up & re-format code samples #12754

Merged
merged 1 commit into from
Nov 7, 2024

Conversation

Valeriy-Burlaka
Copy link
Member

@Valeriy-Burlaka Valeriy-Burlaka commented Nov 7, 2024

Description

Fixes the sample for Vertex AI "Get Rouge Score" section.
The "prompt" column in the sample input dataset is misleading, as the SDK will not use this column if the model argument is not provided. Without model, providing only "response" and "reference" columns is sufficient.

As a follow up to this fix, I'm considering to update this sample to mention both options of computing these metrics, similarly how we did here, i.e.: 1) BYOR (current option); 2) Running model inference to obtain "response".

Checklist

@Valeriy-Burlaka Valeriy-Burlaka self-assigned this Nov 7, 2024
@Valeriy-Burlaka Valeriy-Burlaka requested review from a team as code owners November 7, 2024 11:59
@product-auto-label product-auto-label bot added the samples Issues that are directly related to samples. label Nov 7, 2024
@Valeriy-Burlaka Valeriy-Burlaka added api: vertex-ai Issues related to the Vertex AI API. needs review labels Nov 7, 2024
Copy link
Member

@msampathkumar msampathkumar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@msampathkumar msampathkumar changed the title fix(gen ai): fix 'get_rouge_score' sample - remove unused dataset param chore(generative_ai): clean up & re-format code samples Nov 7, 2024
@msampathkumar msampathkumar merged commit 43daedc into main Nov 7, 2024
14 checks passed
@msampathkumar msampathkumar deleted the vburlaka-fix-evaluation-rouge-score-sample branch November 7, 2024 14:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: vertex-ai Issues related to the Vertex AI API. needs review samples Issues that are directly related to samples.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants