-
Notifications
You must be signed in to change notification settings - Fork 1.2k
Setting up an environment for Langchain development with TGI Containers #3119
Unanswered
penard-monkey
asked this question in
Q&A
-
I'm working on a langchain project and I want to get it up and running locally. I was hoping to get TGI container running in Docker on my Mac Studio but I guess TGI doesn't support the metal framework?
I'm switching from OllamaLLM to HuggingFaceEndpoints and I have a HUGE dataset. I don't want to run a large dedicated endpoint until I have it set up correctly. I don't really mind if things take a long time to process during development.
Any thoughts on getting an environment set up with HuggingFaceEndpoints without me spinning up a dedicated endpoint for development?
Beta Was this translation helpful? Give feedback.
All reactions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment