Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

✨ Support Embedding API #67

Open
roma-glushko opened this issue Jan 6, 2024 · 4 comments · May be fixed by #279
Open

✨ Support Embedding API #67

roma-glushko opened this issue Jan 6, 2024 · 4 comments · May be fixed by #279
Assignees
@roma-glushko
Labels
area:api help wanted Extra attention is needed model:embedding size:large type:epic A high level issue that usually consist of smaller tasks and corresponds to some functionality
Milestone
Glide: Public Pre...

Comments

@roma-glushko
Copy link
Member

Add a new set of API to support embeddings:

  • come up with the unified embedding request/response schemas
  • add a new model type to the routers config
  • define at least one provider with embedding capabilities
@roma-glushko roma-glushko changed the title Support Embedding API ✨ Support Embedding API Jan 21, 2024
@roma-glushko roma-glushko added the help wanted Extra attention is needed label Mar 13, 2024
@roma-glushko roma-glushko moved this to Middle Term in [Glide] Roadmap Apr 18, 2024
@roma-glushko roma-glushko added the type:epic A high level issue that usually consist of smaller tasks and corresponds to some functionality label May 1, 2024
@roma-glushko roma-glushko moved this to Backlog in [Glide] Roadmap May 1, 2024
@avinashkurup
Copy link

Hello @roma-glushko,

Following up on our recent Discord thread, we are currently evaluating your project for a use case that involves Retrieval-Augmented Generation (RAG) and embedding as key components.

We are very excited about the LLMOps features in this project and would love to leverage them for our needs. Could you please let us know if the embedding API is planned for introduction in the near future?

Thank you for your assistance!

@roma-glushko roma-glushko self-assigned this Jun 13, 2024
@roma-glushko roma-glushko moved this from Backlog to Implementation in [Glide] Roadmap Jun 13, 2024
roma-glushko added a commit that referenced this issue Jun 18, 2024
@roma-glushko
#67: Inited a new embedding router
8819af8
roma-glushko added a commit that referenced this issue Jun 24, 2024
@roma-glushko
#67: Moved resiliency and client packages on higher level out of prov…
27347ec 
…iders & routers
@roma-glushko roma-glushko linked a pull request Jun 24, 2024 that will close this issue
#67: Introducing embedding API #279
Draft
roma-glushko added a commit that referenced this issue Jun 24, 2024
@roma-glushko
#67: Collected changelog for 0.1.0-rc.1
7faf386
@avinashkurup
Copy link

Thank you so much, @roma-glushko, I will test this branch.

@roma-glushko
Copy link
Member Author

Hey @avinashkurup I have not yet gotten the end to end flow, it's just an early draft with WIP right now. Just to be clear here.

roma-glushko added a commit that referenced this issue Jul 5, 2024
@roma-glushko
#67: Restructure router config, model & provider interfaces to incorp…
d842fa0 
…orate the new embedding router
roma-glushko added a commit that referenced this issue Jul 5, 2024
@roma-glushko
#67: Fixed broken code after the first wave of refactoring/restructuring
c924140
@avinashkurup
Copy link

Thank you!!! @roma-glushko , Extremely sorry for the delay in communication. Will test this.

roma-glushko added a commit that referenced this issue Jul 31, 2024
@roma-glushko
#67: Experimenting with dynamic lang provider config loading & valida…
003691c 
…tion
roma-glushko added a commit that referenced this issue Aug 8, 2024
@roma-glushko
#67: Fixed a part of linting errors
e043e4d
roma-glushko added a commit that referenced this issue Aug 8, 2024
@roma-glushko
#67: Picked more idiomatic naming for the ProviderID
339e3f9
roma-glushko added a commit that referenced this issue Aug 8, 2024
@roma-glushko
#67: Got rid of provider package & did other layout restructuring to …
b662b1e 
…fix circular dependency issues
roma-glushko added a commit that referenced this issue Aug 8, 2024
@roma-glushko
#67: Renamed providers package to just provider
5ad821c
roma-glushko added a commit that referenced this issue Aug 8, 2024
@roma-glushko
#67: Onboarded cohere to the new Configurer interface
4aa7b2b
roma-glushko added a commit that referenced this issue Aug 8, 2024
@roma-glushko
#67: Onboarded anthropic to the new Configurer interface
d1cb962
roma-glushko added a commit that referenced this issue Aug 12, 2024
@roma-glushko
#67: Moved lang & embed router into the routers package & ensured Lan…
f872d72 
…gProvider interface
roma-glushko added a commit that referenced this issue Aug 12, 2024
@roma-glushko
#67: Renamed routers to router package
f55b24e
roma-glushko added a commit that referenced this issue Aug 12, 2024
@roma-glushko
#67: Ensured the ChatStream interface
d1659d3
roma-glushko added a commit that referenced this issue Aug 12, 2024
@roma-glushko
#67: Started to connect EmbedRouter into the system
e526611
roma-glushko added a commit that referenced this issue Aug 12, 2024
@roma-glushko
#67: Moved the cmd out of pkgs
24be91c
roma-glushko added a commit that referenced this issue Aug 12, 2024
@roma-glushko
#67: Renamed schemas to schema
65d4fa0
roma-glushko added a commit that referenced this issue Aug 12, 2024
@roma-glushko
#67: Renamed the health schema
e2817c0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@roma-glushko roma-glushko

Labels
area:api help wanted Extra attention is needed model:embedding size:large type:epic A high level issue that usually consist of smaller tasks and corresponds to some functionality
Projects
[Glide] Roadmap
Status: Implementation
Milestone
Glide: Public Preview
Development

Successfully merging a pull request may close this issue.

#67: Introducing embedding API EinStack/glide
2 participants
@avinashkurup @roma-glushko