-
Notifications
You must be signed in to change notification settings - Fork 43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Run GPU supported LLM inside container with devcontainer #143
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Kiran1689 <[email protected]>
Signed-off-by: Kiran1689 <[email protected]>
Signed-off-by: Kiran1689 <[email protected]>
@mojafa Can you please review this? If possible, please assign the issue to me |
guides/20250123_guide_Run_GPU_supported_LLM_inside_container_with_devcontainer.md
Outdated
Show resolved
Hide resolved
guides/20250123_guide_Run_GPU_supported_LLM_inside_container_with_devcontainer.md
Show resolved
Hide resolved
guides/20250123_guide_Run_GPU_supported_LLM_inside_container_with_devcontainer.md
Show resolved
Hide resolved
guides/20250123_guide_Run_GPU_supported_LLM_inside_container_with_devcontainer.md
Outdated
Show resolved
Hide resolved
@Kiran1689 I believe you can use Daytona without spinning up a Linux server/vm on cloud. Specify all the necessary packages and images in a Dockerfile and have it in your devcontainer folder. something like that |
Signed-off-by: Kiran1689 <[email protected]>
Signed-off-by: Kiran1689 <[email protected]>
Updated @mojafa |
@Kiran1689 thansk for incorporating the changes. I'll get a Linux VM tomorrow and test the code. |
Sure @mojafa |
Signed-off-by: Kiran1689 <[email protected]>
@Kiran1689 Thank you so much for your patience and responses. I've finaally manged ot get around to test this PR. Nice stuff, managed to get the GPU based VM, installed docker, daytona, git, nvidia, nano and vscode. Wow that was a mouthful one! Was able to run |
As discussed please fix the intros, and the TL;DR sections, also run the article once through Grammarly or something like that! Good stuff man! |
Signed-off-by: Kiran1689 <[email protected]>
Thanks for your cooperation, @mojafa 🙏 Updated the changes |
@nkkko This PR meets the requirements. Please check |
/claim #4
fixes #4
Writer's Checklist
Writing Structure
(use this tool)
section.
TLDRs, and key points.
code elements
andMarkdown format
where appropriate.(screenshots, diagrams, tables, graphs, lists, sidenotes, blockquotes).
Fact-Checking
Asset Management
/assets
folder.YYYYMMDD_title_of_the_article_IMG_NAME_NO.png
.share it.
Interlinking
CTRL+F
to search for relevant keywords in:Glossary/Definitions
/defitnitions
folder.Review and Edit
intent.
grammar tool.