Skip to content

Commit

Permalink
Merge pull request #663 from jannesDoege/patch-1
Browse files Browse the repository at this point in the history
Fixed typo in ai-sql-accuracy-2023-08-17.md
  • Loading branch information
zainhoda authored Oct 23, 2024
2 parents 6145610 + df24227 commit ed26e2a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion papers/ai-sql-accuracy-2023-08-17.md
Original file line number Diff line number Diff line change
Expand Up @@ -229,7 +229,7 @@ By providing just those 3 example queries, we see substantial improvements to th

Enterprise data warehouses often contain 100s (or even 1000s) of tables, and an order of magnitude more queries that cover all the use cases within their organizations. Given the limited size of the context windows of modern LLMs, we can’t just shove all the prior queries and schema definitions into the prompt.

Our final approach to context is a more sophisticated ML approach - load embeddings of prior queries and the table schemas into a vector database, and only choose the most relevant queries / tables to the question asked. Here's a diagram of what we are doing - note the contextual relevance search in the red box -
Our final approach to context is a more sophisticated ML approach - load embeddings of prior queries and the table schemas into a vector database, and only choose the most relevant queries / tables to the question asked. Here's a diagram of what we are doing - note the contextual relevance search in the green box -

![](https://raw.githubusercontent.com/vanna-ai/vanna/main/papers/img/using-contextually-relevant-examples.png)

Expand Down

0 comments on commit ed26e2a

Please sign in to comment.