Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Seek alternative package lookup system #431

Open
lukehinds opened this issue Dec 20, 2024 · 0 comments
Open

Seek alternative package lookup system #431

lukehinds opened this issue Dec 20, 2024 · 0 comments

Comments

@lukehinds
Copy link
Contributor

Within the current version, we leverage the users selected large language model to extract package / module / library names from code snippets. While this was a good approach for our first version, it maybe worth considering other options, as a level of overhead comes from the large language models processing times. When combined with embeddings and vectorization, it appears it has a noticeable impact on performance within the users path / experience.

In the previous prototype , tree sitter was used, but the library is lacking support for wide library coverege, so a different approach maybe required.

This Story is to allow research over alternative approaches, proof of concept to demonstrate a notable performance improvement and then implementation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant