ragas expt update

backend/app/ragas_dataset.csv

@@ -1,52 +1,69 @@
-question,context,answer,ground_truth
+question,context,answer,ground_truth
 Where did the study Recipient Vessels for Free Tissue Flaps in Advanced Oncologic Defects of the Midface and Scalp take place,"SELECT si.title, si.study_details->>'source' AS study_source
 FROM tbl_studies_info si
 WHERE si.title = 'Recipient Vessels for Free Tissue Flaps in Advanced Oncologic Defects of the Midface and Scalp';
 
 SQLResult:
 
-| title |[('Recipient Vessels for Free Tissue Flaps in Advanced Oncologic Defects of the Midface and Scalp', 'Instituto Nacional de Cancer, Brazil')]","The study Recipient Vessels for Free Tissue Flaps in Advanced Oncologic Defects of the Midface and Scalp took place at the Instituto Nacional de Cancer, Brazil. This is based on the database output which shows that the study was conducted by the Instituto Nacional de Cancer, Brazil.",University of Texas MD Anderson Cancer Center
+| title |[('Recipient Vessels for Free Tissue Flaps in Advanced Oncologic Defects of the Midface and Scalp', 'Instituto Nacional de Cancer, Brazil')]","The study Recipient Vessels for Free Tissue Flaps in Advanced Oncologic Defects of the Midface and Scalp took place at the Instituto Nacional de Cancer, Brazil. This is based on the database output which shows that the study was conducted by the Instituto Nacional de Cancer, Brazil.","Instituto Nacional de Cancer, Brazil"
 "How many participants was enrolled in Exposure, Dose, Body Burden and Health Effects of Lead","SELECT si.study_details->>'enrollment' AS enrollment_count
 FROM tbl_studies_info si
 WHERE si.title = 'Exposure, Dose, Body Burden and Health Effects of Lead';
 
 Reasoning:
 
-1. First, we need to select the rows from the ""[('944',)]","The study Exposure, Dose, Body Burden and Health Effects of Lead enrolled 944 participants. This is based on the database output which shows that the study enrolled 944 participants.",944
+1. First, we need to select the rows from the ""[('944',)]","The study Exposure, Dose, Body Burden and Health Effects of Lead enrolled 944 participants. This is based on the database output which shows that the study enrolled 944 participants.",944
 What is the purpose of the study Safety and Tolerability of RNS60 Given by IV to Healthy Subjects,"SELECT title, description FROM tbl_studies_info WHERE title = 'Safety and Tolerability of RNS60 Given by IV to Healthy Subjects';
 
 Reasoning:
 
-1. We need to extract the information from the 'tbl_studies_eligibilities' and 'tbl_studies_info[('Safety and Tolerability of RNS60 Given by IV to Healthy Subjects', 'The objective of this study is to evaluate the safety and tolerability of RNS60 administered intravenously to healthy subjects. 12 subjects will receive RNS60 or placebo at three escalating rates for 48 hours for each rate.')]",The purpose of the study Safety and Tolerability of RNS60 Given by IV to Healthy Subjects is to evaluate the safety and tolerability of RNS60 administered intravenously to healthy subjects. 12 subjects will receive RNS60 or placebo at three escalating rates for 48 hours for,"Study to investigate the effect of two types of radiotherapy on saliva: IMRT versus conventional radiotherapy.
+1. We need to extract the information from the 'tbl_studies_eligibilities' and 'tbl_studies_info[('Safety and Tolerability of RNS60 Given by IV to Healthy Subjects', 'The objective of this study is to evaluate the safety and tolerability of RNS60 administered intravenously to healthy subjects. 12 subjects will receive RNS60 or placebo at three escalating rates for 48 hours for each rate.')]",The purpose of the study Safety and Tolerability of RNS60 Given by IV to Healthy Subjects is to evaluate the safety and tolerability of RNS60 administered intravenously to healthy subjects. 12 subjects will receive RNS60 or placebo at three escalating rates for 48 hours for,"evaluate the safety and tolerability of the drug RNS60 administered intravenously in healthy male subjects. The study involves testing three escalating dosage rates of RNS60 or placebo over a period of 48 hours for each rate.
 
-In each group, one part will receive normal dental preventive treatment. The other part will use products for treatment of dry mouth (Biotene gamma).
 
-Both anorganic and organic components of the saliva will be studied at different time points, combined with bacterial swabs.
 
- "
+
+
+
+
+"
 What is the purpose of the study Recreational Diving Practice for Stress Management (DIVSTRESS),"SELECT title, description FROM tbl_studies_info WHERE title = 'Recreational Diving Practice for Stress Management (DIVSTRESS)';
 
 Reasoning:
 
-1. First, we need to identify the study we are interested in. In this case, the study is ""Recreational Diving Practice for Stress[]",The purpose of the study Recreational Diving Practice for Stress Management (DIVSTRESS) is to investigate the effects of recreational diving on stress management. This is based on the database output which shows that the study is about recreational diving and stress management.,"Within the components of Scuba diving there are similarities with meditation and mindfulness techniques. Perceived stress is known to be diminished during meditation practice. This study evaluates the benefits of scuba diving on perceived stress and mindful functioning.
-Detailed"
+1. First, we need to identify the study we are interested in. In this case, the study is ""Recreational Diving Practice for Stress[]",The purpose of the study Recreational Diving Practice for Stress Management (DIVSTRESS) is to investigate the effects of recreational diving on stress management. This is based on the database output which shows that the study is about recreational diving and stress management.,"evaluate the benefits of scuba diving on perceived stress and mindful functioning. It compared the effects of a one-week recreational diving course on perceived stress, mood, well-being, and mindfulness against a control group engaged in various sports activities. The study also assessed the stability of these effects one month later.
+
+
+
+
+
+
+
+"
 How many participants was enrolled in Recreational Diving Practice for Stress Management (DIVSTRESS),"SELECT si.title, si.study_details->>'enrollment' AS enrollment_count
 FROM tbl_studies_info si
 WHERE si.title = 'Recreational Diving Practice for Stress Management (DIVSTRESS)';
 
-This SQL query uses the ->> operator to extract the value of the '[]",The study Recreational Diving Practice for Stress Management (DIVSTRESS) did not have any participants enrolled. This is based on the database output which shows that the study did not have any participants enrolled.,67
+This SQL query uses the ->> operator to extract the value of the '[]",The study Recreational Diving Practice for Stress Management (DIVSTRESS) did not have any participants enrolled. This is based on the database output which shows that the study did not have any participants enrolled.,67
 "What treatment was given to the participants in Exposure, Dose, Body Burden and Health Effects of Lead","SELECT si.title, si.study_details->>'treatment' AS treatment
 FROM tbl_studies_info si
 WHERE si.title = 'Exposure, Dose, Body Burden and Health Effects of Lead';
 
 Reasoning:
 
-1. First, we need to identify the relevant tables and columns[('Exposure, Dose, Body Burden and Health Effects of Lead', None)]","The treatment given to the participants in Exposure, Dose, Body Burden and Health Effects of Lead is not available in the database output. This is because the column 'treatment' is not present in the table 'tbl_studies_info' for the study 'Exposure, Dose, Body Burden and Health Effects of",Not given
+1. First, we need to identify the relevant tables and columns[('Exposure, Dose, Body Burden and Health Effects of Lead', None)]","The treatment given to the participants in Exposure, Dose, Body Burden and Health Effects of Lead is not available in the database output. This is because the column 'treatment' is not present in the table 'tbl_studies_info' for the study 'Exposure, Dose, Body Burden and Health Effects of",Not given
 What does this following study does: Safety and Tolerability of RNS60 Given by IV to Healthy Subjects,"SELECT title, description, eligibility_details ->> 'Criteria' as criteria FROM tbl_studies_eligibilities WHERE title = 'Safety and Tolerability of RNS60 Given by IV to Healthy Subjects';
 
-This SQL query selects the title, description, and criteria fields from the tbl_studies[('Safety and Tolerability of RNS60 Given by IV to Healthy Subjects', 'The objective of this study is to evaluate the safety and tolerability of RNS60 administered intravenously to healthy subjects. 12 subjects will receive RNS60 or placebo at three escalating rates for 48 hours for each rate.', 'Inclusion Criteria:  Males between 18-55 years Minimum body weight of 60 kg BMI of 18-32 kg/m2 Able to execute informed written consent  Exclusion Criteria:  A chronic or acute disease that might interfere with the evaluation of the safety of RNS60 Current or prior malignancies (excluding...')]","This study does not have any specific criteria for eligibility. The criteria field in the database output is empty, which means that the study does not have any specific criteria for eligibility.",evaluate the safety and tolerability of RNS60 administered intravenously to healthy subjects. 12 subjects will receive RNS60 or placebo at three escalating rates for 48 hours for each rate.
+This SQL query selects the title, description, and criteria fields from the tbl_studies[('Safety and Tolerability of RNS60 Given by IV to Healthy Subjects', 'The objective of this study is to evaluate the safety and tolerability of RNS60 administered intravenously to healthy subjects. 12 subjects will receive RNS60 or placebo at three escalating rates for 48 hours for each rate.', 'Inclusion Criteria:  Males between 18-55 years Minimum body weight of 60 kg BMI of 18-32 kg/m2 Able to execute informed written consent  Exclusion Criteria:  A chronic or acute disease that might interfere with the evaluation of the safety of RNS60 Current or prior malignancies (excluding...')]","This study does not have any specific criteria for eligibility. The criteria field in the database output is empty, which means that the study does not have any specific criteria for eligibility.","the safety and tolerability of RNS60, administered intravenously, in healthy subjects. It was a Phase 1, double-blind, randomized, placebo-controlled trial involving 12 participants, who received RNS60 or placebo at three escalating rates for 48 hours each. The study took place between July and September 2011.
+
+
+
+
+
+
+
+"
 What is the type of following study: Recreational Diving Practice for Stress Management (DIVSTRESS),"SELECT si.title, si.study_details->>'study_type' AS study_type
 FROM tbl_studies_info si
 WHERE si.title = 'Recreational Diving Practice for Stress Management (DIVSTRESS)';
 
-This SQL query selects the title and study type of the study with the given title[]","The study Recreational Diving Practice for Stress Management (DIVSTRESS) is a randomized controlled trial. This is based on the database output which shows that the study type is ""randomized controlled trial"".",Observational
+This SQL query selects the title and study type of the study with the given title[]","The study Recreational Diving Practice for Stress Management (DIVSTRESS) is a randomized controlled trial. This is based on the database output which shows that the study type is ""randomized controlled trial"".",Observational