932 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
1
vote
2
answers
127
views
ImportError: cannot import name 'MistralCommonBackend' from 'transformers'
Given:
$ pip install transformers mistral-common -Uq
$ pip show transformers mistral-common torch # to verify
Name: transformers
Version: 4.57.3
Summary: State-of-the-art Machine Learning for JAX, ...
0
votes
0
answers
56
views
Vercel Deployment Error: "libonnxruntime.so.1: cannot open shared object file" with @huggingface/transformers in Next.js
I am building a Next.js (App Router) application that uses @huggingface/transformers (Transformers.js) to run a feature-extraction model (Xenova/all-MiniLM-L6-v2) for RAG functionality.
The ...
Advice
0
votes
0
replies
53
views
What is the best text embedding model for ecommerce product search (short, noisy user queries)?
I am integrating a vector-based semantic search system into a large ecommerce platform's product search, and I want to select the right text embedding model.
Use Case
User queries are often:
Very ...
-1
votes
0
answers
68
views
When Running a GGUF Model from Hugging Face Using Ollama, How Will the Modelfile Be Selected?
Background Knowledge
According to the Hugging Face documentation, now it's supported to run a GGUF model directly using Ollama with ollama run hf.co/bartowski/Llama-3.2-1B-Instruct-GGUF something like ...
0
votes
1
answer
328
views
Error in pyannote.audio Pipeline. Python. HuggingFace
Getting issue with use_auth_token keyword while implementing a pipeline from pyannote.audio.
I already used:-
pipeline = Pipeline.from_pretrained("pyannote/speaker-diarization-3.1", ...
1
vote
0
answers
201
views
Transformers 'could not import module pipeline' to jupyter notebook
I need to to run a series of pre-trained fine-tuned models from Hugging Face to Jupyter notebook. I have updated to the latest version of both PyTorch and Transformers, but when I run the code
from ...
1
vote
1
answer
92
views
Xcode Can't Find swift-transformers Package
I'm trying to implement Speech-to-Text transcription in my Swift app using Hugging Face's swift-transformers package to run Whisper models locally.
I've added the package to my Xcode project, but when ...
1
vote
0
answers
69
views
How to pass P_map: dict[str, torch.Tensor] to PEFT (LoRA)?
My proxy goal is to change LoRA from h = (W +BA)x to h = (W + BAP)x. Preliminary code attached for your reference
My actual goal is to train a model with the following loss: 〖Θ ̃=(arg min)┬Δ ̂ 〗〖‖f_(...
0
votes
2
answers
137
views
LangChain HuggingFace ChatHuggingFace raises StopIteration with any model
I’m trying to use LangChain’s Hugging Face integration to chat with the model TinyLlama/TinyLlama-1.1B-Chat-v1.0 for the very first time, but I’m getting a StopIteration error when calling .invoke().
...
0
votes
0
answers
68
views
ONNX Runtime Helsinki-NLP in Java
has anyone managed to translate something using Helsinki-NLP and ONNX Runtime in Java? Using a Python script, I generated these files:
├── encoder_model.onnx
├── decoder_model.onnx
├── ...
2
votes
1
answer
84
views
Why does my system message content contain "image": None when mapping conversation dataset?
I'm creating a conversation dataset for an image classification task where the system message should contain only text, and the user message contains both text and an image. However, after mapping my ...
1
vote
0
answers
119
views
tokenizer error: RuntimeError: The size of tensor a (4) must match the size of tensor b (8) at non-singleton dimension 0
When fine tuning a model, using the HuggingFace inference hub, the error below was encountered:
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The ...
0
votes
0
answers
113
views
How to solve device mismatch issue when using offloading with QwenImageEditPlus pipeline and GGUF weights
After failing to make the QwenImageEditPlus run (https://huggingface.co/spaces/discord-community/README/discussions/9#68d260e32053323e6bfab30c), I tried a different approach (thanks to all the example ...
1
vote
0
answers
61
views
Why does hugging face trainer still recognize different device between my encoder & classifier head even after I manually map it on the same device
I encounterd this error while trying to run hugging face trainer on a multi-gpu.
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1!
I use a ...
0
votes
1
answer
513
views
Hugging face api is not returning any response and receiving errors
I have been stepping into GenAI and currently I am working with Hugging face's open source models. However, I am not able to receive any response from the API. I have created access token on hugging ...