Skip to content

Commit

Permalink
Updated writer.prompty
Browse files Browse the repository at this point in the history
  • Loading branch information
@truptiparkar7
truptiparkar7 committed Sep 10, 2024
1 parent 187b0e9 commit a2566cf
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 6 deletions.
2 changes: 1 addition & 1 deletion src/api/evaluate/eval_results.jsonl
View file
Original file line number Diff line number Diff line change
@@ -1 +1 @@
[{"research_context": "Can you find the latest camping trends and what folks are doing in the winter?", "gpt_relevance": 5.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 5.0}, {"research_context": "Can you find the latest trends in hiking shoes?", "gpt_relevance": 5.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 1.0}, {"research_context": "Find information about the best snow camping spots in the world", "gpt_relevance": 5.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 1.0}]
[{"research_context": "Can you find the latest camping trends and what folks are doing in the winter?", "gpt_relevance": 1.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 5.0}, {"research_context": "Can you find the latest trends in hiking shoes?", "gpt_relevance": 1.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 3.0}, {"research_context": "Find information about the best snow camping spots in the world", "gpt_relevance": 5.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 5.0}]
10 changes: 5 additions & 5 deletions src/api/evaluate/eval_results.md
View file
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
| | research_context | gpt_relevance | gpt_fluency | gpt_coherence | gpt_groundedness |
|---:|:-------------------------------------------------------------------------------|----------------:|--------------:|----------------:|-------------------:|
| 0 | Can you find the latest camping trends and what folks are doing in the winter? | 5 | 5 | 5 | 5 |
| 1 | Can you find the latest trends in hiking shoes? | 5 | 5 | 5 | 1 |
| 2 | Find information about the best snow camping spots in the world | 5 | 5 | 5 | 1 |
| 0 | Can you find the latest camping trends and what folks are doing in the winter? | 1 | 5 | 5 | 5 |
| 1 | Can you find the latest trends in hiking shoes? | 1 | 5 | 5 | 3 |
| 2 | Find information about the best snow camping spots in the world | 5 | 5 | 5 | 5 |

Averages scores:

| | 0 |
|:-----------------|--------:|
| gpt_relevance | 5 |
| gpt_relevance | 2.33333 |
| gpt_fluency | 5 |
| gpt_coherence | 5 |
| gpt_groundedness | 2.33333 |
| gpt_groundedness | 4.33333 |

0 comments on commit a2566cf

Please sign in to comment.