jim/openai-cookbook
1
0
Fork 0
mirror of https://github.com/james-m-jordan/openai-cookbook.git synced 2025-05-09 19:32:38 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update Getting_Started_with_OpenAI_Evals.ipynb (#1448)

Browse Source
This commit is contained in:
Sofia Ferreira 2024-10-14 12:06:21 +02:00 committed by GitHub
parent b72cade08e
commit 4ce56a2f82
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/evaluation/Getting_Started_with_OpenAI_Evals.ipynb
View File

@ -394,8 +394,6 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"These CLIs can accept various flags to modify their default behavior. You can run `oaieval --help` to see a full list of CLI options. \n",
"\n",
"`oaieval` will search for the `spider-sql` eval YAML file in the `evals/registry/evals` directory, following the format specified in cell 4 above. The path to the eval dataset is specified in the eval YAML file under the args: parameter as `samples_jsonl: sql/spider_sql.jsonl`, with the file content in JSONL format (as generated in step 3 above).\n",
"\n",
"After running that command, you’ll see the final report of accuracy printed to the console, as well as a file path to a temporary file that contains the full report."