Skip to content

Commit 85aee50

Browse files
author
James Liounis
committed
add merveenoyan comments
1 parent c1d976f commit 85aee50

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

notebooks/en/llm_judge_evaluating_ai_search_engines_with_judges_library.ipynb

+3-3
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@
4545
"\n",
4646
"## [Setup](#setup)\n",
4747
"\n",
48-
"We use the [Natural Questions dataset](https://paperswithcode.com/dataset/natural-questions) -- a collection of real-world Google queries and corresponding Wikipedia articles -- as our benchmark for comparing the quality of different AI search engines, as follows:\n",
48+
"We use the [Natural Questions dataset](https://paperswithcode.com/dataset/natural-questions), an open-source collection of real Google queries and Wikipedia articles, to benchmark AI search engine quality.\n",
4949
"\n",
5050
"1. Start with a [**100-datapoint subset of Natural Questions**](https://huggingface.co/datasets/quotientai/natural-qa-random-100-with-AI-search-answers), which only includes human evaluated answers and their corresponding queries for correctness, clarity, and completeness. We'll use these as the ground truth answers to the queries.\n",
5151
"2. Use different **AI search engines** (Perplexity, Exa, and Gemini) to generate responses to the queries in the dataset.\n",
@@ -160,7 +160,7 @@
160160
"id": "SWYaCZEPj_WX"
161161
},
162162
"source": [
163-
"You can either set the API keys from a `.env` file, such as what we are doing below, or from Google Colab secrets, in which case, uncomment the relevant code examples below."
163+
"You can either set the API keys from a `.env` file, such as what we are doing below. "
164164
]
165165
},
166166
{
@@ -691,7 +691,7 @@
691691
"id": "mBiuYKjXiS1s"
692692
},
693693
"source": [
694-
"We opt for `together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo`. Since we are using a model from [TogetherAI](https://www.together.ai), we need to set a Together API key as an environment variable."
694+
"We opt for `together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo`. Since we are using a model from [TogetherAI](https://www.together.ai), we need to set a Together API key as an environment variable. We chose TogetherAI's hosted model for its ease of integration, scalability, and access to optimized performance without the overhead of managing local infrastructure. "
695695
]
696696
},
697697
{

0 commit comments

Comments
 (0)