Skip to content

Commit 7076d61

Browse files
Merge pull request #832 from JohnSnowLabs/chore/website_nb_updates
Chore/website nb updates
2 parents f21cf5f + 6e344c9 commit 7076d61

45 files changed

Lines changed: 2638 additions & 2432 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎README.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -95,6 +95,8 @@ Langtest comes with different datasets to test your models, covering a wide rang
9595
| [**SIQA**](https://arxiv.org/abs/1904.09728) | Evaluate your model's performance by assessing its accuracy in understanding social situations, inferring the implications of actions, and comparing human-curated and machine-generated answers. | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/JohnSnowLabs/langtest/blob/main/demo/tutorials/llm_notebooks/dataset-notebooks/SIQA_dataset.ipynb) |
9696
| [**PIQA**](https://arxiv.org/abs/1911.11641) | Evaluate your model's performance on the PIQA dataset, which tests its ability to reason about everyday physical situations through multiple-choice questions, contributing to AI's understanding of real-world interactions. | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/JohnSnowLabs/langtest/blob/main/demo/tutorials/llm_notebooks/dataset-notebooks/PIQA_dataset.ipynb)
9797
| [**MultiLexSum**](https://arxiv.org/abs/2206.10883) | Evaluate your model's ability to generate concise and informative summaries for legal case contexts from the Multi-LexSum dataset, with a focus on comprehensively capturing essential themes and key details within the legal narratives. | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/JohnSnowLabs/langtest/blob/main/demo/tutorials/llm_notebooks/dataset-notebooks/MultiLexSum_dataset.ipynb) |
98+
| [**FIQA**](https://paperswithcode.com/dataset/fiqa-1) | Evaluate your model's performance on the FiQA dataset, a comprehensive and specialized resource designed for finance-related question-answering tasks. | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/JohnSnowLabs/langtest/blob/main/demo/tutorials/llm_notebooks/dataset-notebooks/Fiqa_dataset.ipynb) |
99+
98100

99101
> **Note**
100102
> For usage and documentation, head over to [langtest.org](https://langtest.org/docs/pages/docs/data#question-answering)

‎demo/tutorials/llm_notebooks/AI21_QA_Summarization_Testing_Notebook.ipynb‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@
5454
},
5555
"outputs": [],
5656
"source": [
57-
"!pip install \"langtest[evaluate,ai21,langchain,transformers]\" "
57+
"!pip install \"langtest[evaluate,ai21,transformers]\" "
5858
]
5959
},
6060
{

‎demo/tutorials/llm_notebooks/Clinical_Tests.ipynb‎

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -59,8 +59,6 @@
5959
"source": [
6060
"import os\n",
6161
"\n",
62-
"import openai\n",
63-
"\n",
6462
"os.environ[\"OPENAI_API_KEY\"] = <ADD OPEN-AI-KEY>\n"
6563
]
6664
},

‎demo/tutorials/llm_notebooks/Cohere_QA_Summarization_Testing_Notebook.ipynb‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@
4848
"metadata": {},
4949
"outputs": [],
5050
"source": [
51-
"!pip install \"langtest[evaluate,cohere,langchain,transformers]\" "
51+
"!pip install \"langtest[evaluate,cohere,transformers]\" "
5252
]
5353
},
5454
{

‎demo/tutorials/llm_notebooks/Disinformation_Test.ipynb‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@
3636
"metadata": {},
3737
"outputs": [],
3838
"source": [
39-
"!pip install \"langtest[ai21,langchain,transformers]\" "
39+
"!pip install \"langtest[ai21,transformers]\" "
4040
]
4141
},
4242
{

‎demo/tutorials/llm_notebooks/Factuality_Test.ipynb‎

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -173,8 +173,6 @@
173173
"source": [
174174
"import os\n",
175175
"\n",
176-
"import openai\n",
177-
"\n",
178176
"os.environ[\"OPENAI_API_KEY\"] = \"<YOUR_API_KEY>\""
179177
]
180178
},
@@ -1391,7 +1389,7 @@
13911389
"name": "python",
13921390
"nbconvert_exporter": "python",
13931391
"pygments_lexer": "ipython3",
1394-
"version": "3.9.13"
1392+
"version": "3.9.6"
13951393
},
13961394
"orig_nbformat": 4
13971395
},

‎demo/tutorials/llm_notebooks/Legal_Support.ipynb‎

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -59,9 +59,7 @@
5959
"source": [
6060
"import os\n",
6161
"\n",
62-
"import openai\n",
63-
"\n",
64-
"os.environ[\"OPENAI_API_KEY\"] = <ADD OPEN-AI-KEY>"
62+
"os.environ[\"OPENAI_API_KEY\"] = \"<ADD OPEN-AI-KEY>\""
6563
]
6664
},
6765
{

‎demo/tutorials/llm_notebooks/OpenAI_QA_Summarization_Testing_Notebook.ipynb‎

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -134,8 +134,6 @@
134134
"source": [
135135
"import os\n",
136136
"\n",
137-
"import openai\n",
138-
"\n",
139137
"os.environ[\"OPENAI_API_KEY\"] = \"<YOUR_API_KEY>\""
140138
]
141139
},

‎demo/tutorials/llm_notebooks/Sensitivity_Test.ipynb‎

Lines changed: 1 addition & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -36,14 +36,7 @@
3636
"metadata": {},
3737
"outputs": [],
3838
"source": [
39-
"!pip install \"langtest[evaluate,openai,transformers]\" "
40-
]
41-
},
42-
{
43-
"cell_type": "markdown",
44-
"metadata": {},
45-
"source": [
46-
"Tiktoken is a fast BPE tokeniser for use with OpenAI's models."
39+
"!pip install \"langtest[evaluate,openai,transformers]\""
4740
]
4841
},
4942
{
@@ -54,8 +47,6 @@
5447
"source": [
5548
"import os\n",
5649
"\n",
57-
"import openai\n",
58-
"\n",
5950
"os.environ[\"OPENAI_API_KEY\"] = \"<YOUR_API_KEY>\""
6051
]
6152
},

‎demo/tutorials/llm_notebooks/Sycophancy_test.ipynb‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -161,7 +161,6 @@
161161
"outputs": [],
162162
"source": [
163163
"import os\n",
164-
"import openai\n",
165164
"os.environ[\"OPENAI_API_KEY\"] = \"<YOUR_API_KEY>\""
166165
]
167166
},

0 commit comments

Comments
 (0)