Skip to content

Commit

Permalink
added clarifications for the lab in slides and README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
DmitryKey committed Dec 3, 2024
1 parent 8ba55ad commit c8be664
Show file tree
Hide file tree
Showing 4 changed files with 61 additions and 2 deletions.
15 changes: 14 additions & 1 deletion week-6/README.md
Original file line number Diff line number Diff line change
@@ -1 +1,14 @@
# Use cases and applications of LLMs
# Use cases and applications of LLMs

[Week 6 Slides](Use%20cases%20and%20applications%20of%20LLMs%20-%20Lecture%206.pdf)

# Lab
1. Query tables in natural language. See [query_tables.py](query_tables.py)
a. Improve code by loading all sections to avoid hard-coding a section with tables
b. Test the capabilities of reasoning with table data: can it sum up numbers or do some other calculation?
2. Generate synthetic query with misspellings - only task description is available you need to write the code in [synthetic_data.py](synthetic_data.py)
a. Find the queries in [web_search_queries.csv](web_search_queries.csv), containing example queries from different topics and use cases, like map search, job search, travel and tourism, general knowledge and learning
b. Implement code, that will load one query at a time and generate up to N misspellings.
c. Improve robustness of the method, for example, skip known abbreviations, like JFK.
d. Make misspellings capture a variety of error types (phonetic, omission, transposition, repetition)?
e. Test the resulting query variants with your favourite web search engine. Are results equal for the same for all variants of a given query? If not, why do you think this is happening?
Binary file modified week-6/Use cases and applications of LLMs - Lecture 6.pdf
Binary file not shown.
2 changes: 1 addition & 1 deletion week-6/synthetic_data.py
Original file line number Diff line number Diff line change
Expand Up @@ -22,4 +22,4 @@
# 2. Do all variants make sense?
# 3. How to improve robustness of the method, for example, skip known abbreviations, like JFK or NBC.
# 4. Can you test multiple LLMs and figure out which one is the best?
# 5. Do the misspellings capture a variety of error types (phonetic, omission, transposition, repetition,
# 5. Do the misspellings capture a variety of error types (phonetic, omission, transposition, repetition)?
46 changes: 46 additions & 0 deletions week-6/web_search_queries.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
Topic,Query
Map Search,restaurants near Central Park
Map Search,shortest route to Times Square from JFK Airport
Map Search,petrol stations open now in downtown Los Angeles
Map Search,walking directions to Eiffel Tower from Louvre Museum
Map Search,nearest hiking trails in Yosemite National Park
Job Search,software engineer jobs in San Francisco
Job Search,remote work opportunities in marketing
Job Search,freelance graphic design projects for beginners
Job Search,data scientist positions at Google
Job Search,entry-level mechanical engineering jobs in Austin
Flight Search,cheap flights from New York to London
Flight Search,nonstop flights to Tokyo from Los Angeles
Flight Search,business class deals to Paris in December
Flight Search,flights under $500 to Hawaii in January
Flight Search,flight schedules for Delta Airlines to Chicago
E-commerce,best laptops under $1000
E-commerce,organic skincare products with good reviews
E-commerce,discounted furniture for small apartments
E-commerce,latest iPhone models with trade-in offers
E-commerce,top-rated noise-cancelling headphones
Health and Fitness,yoga classes near me
Health and Fitness,gyms with personal trainers in Miami
Health and Fitness,low-carb meal prep ideas for weight loss
Health and Fitness,home remedies for back pain relief
Health and Fitness,best running shoes for flat feet
Entertainment and Media,movies playing near me this weekend
Entertainment and Media,top-rated fantasy novels of 2024
Entertainment and Media,concerts in Chicago this month
Entertainment and Media,free streaming platforms for documentaries
Entertainment and Media,latest episodes of Stranger Things
Travel and Tourism,best hotels in Bali for families
Travel and Tourism,top-rated attractions in Rome
Travel and Tourism,all-inclusive resorts in the Caribbean
Travel and Tourism,visa requirements for US citizens visiting Canada
Travel and Tourism,weather forecast for Cancun next week
General Knowledge and Learning,history of the Great Wall of China
General Knowledge and Learning,how to solve quadratic equations
General Knowledge and Learning,current events in the Middle East
General Knowledge and Learning,free online courses for Python programming
General Knowledge and Learning,most famous paintings by Van Gogh
Local Services,plumbers near me with good reviews
Local Services,24-hour pharmacies in Boston
Local Services,car repair shops in San Diego
Local Services,affordable wedding photographers in New York
Local Services,dog groomers open on Sundays

0 comments on commit c8be664

Please sign in to comment.