Skip to content

Commit

Permalink
change the default non-match indicator to -1 to reflex the previous c…
Browse files Browse the repository at this point in the history
…ommit
  • Loading branch information
wang2226 committed Aug 27, 2024
1 parent b1a2357 commit 5d105b3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion trustllm_pkg/trustllm/task/truthfulness.py
Original file line number Diff line number Diff line change
Expand Up @@ -282,7 +282,7 @@ def eval_internal_codah(self, data):

for item in codah_data:
response = item['res']
prediction = re.findall(r"\d+", response)[0] if re.findall(r"\d+", response) else "0"
prediction = re.findall(r"\d+", response)[0] if re.findall(r"\d+", response) else "-1"
predictions.append(prediction)

gold_labels = [str(item['answer']) for item in codah_data]
Expand Down

0 comments on commit 5d105b3

Please sign in to comment.