Skip to content

Commit

Permalink
Fixed conflicts
Browse files Browse the repository at this point in the history
  • Loading branch information
Nahush26 committed Jan 29, 2024
2 parents 39410d7 + f31f187 commit 186bc1e
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions evaluator_modified.py
Original file line number Diff line number Diff line change
Expand Up @@ -355,6 +355,7 @@ def evaluate(
task = task_dict[task_name]
doc = docs[(task_name, doc_id)]
if reduce=='loglikelihood_test':

ll_gold = requests[int(doc[gold_field[task_name]])-1]
incorrect_requests = [req for req in requests if req != ll_gold]
if incorrect_requests:
Expand Down

0 comments on commit 186bc1e

Please sign in to comment.