nf4

Here are 7 public repositories matching this topic...

Language: All

Filter by language

All 7 Python 3 C++ 1 Jupyter Notebook 1 Rust 1 Gleam 1

intel / neural-speed

An innovative library for efficient LLM inference via low-bit quantization

sparsity cpu gpu int8 low-bit int1 int4 fp8 llamacpp llm-inference gaudi2 nf4 fp4 mxformat llm-fine-tuning int3 int2 int5 int6 int7

Updated Aug 30, 2024
C++

rubi-du / ComfyUI-Flux-Inpainting

Star 43

This repository wraps the flux fill model as ComfyUI nodes. Compared to the flux fill dev model, these nodes can use the flux fill model to perform inpainting and outpainting work under lower VRM conditions

flux inpainting inpaint outpaint outpainting nf4 flux-dev flux-fill

Updated May 14, 2025
Python

EricRollei / Comfy_HunyuanImage3

Star 16

Nodes to run Hunyuan Image 3 locally with BF16 and NF4 quantized options in Comfyui

image ai generation quantization quantized generative-ai comfyui hunyuan nf4 comfyui-custom-node hunyuan-image

Updated Dec 20, 2025
Python

edcalderin / huggingface-ragflow

Star 2

This project implements a classic Retrieval-Augmented Generation (RAG) system using HuggingFace models with quantization techniques. The system processes PDF documents, extracts their content, and enables interactive question-answering through a Streamlit web application.

python cuda text-generation quantization ruff rag huggingface streamlit qdrant large-language-models llm langchain bitsandbytes retrieval-augmented-generation nf4 huggingface-embeddings langchain-community

Updated Jul 18, 2025
Python

azizdeniz890 / gemma-medical-qa-lora

Star 1

This project presents a medical question–answering language model built by fine-tuning Google Gemma-2-2B-IT using LoRA (Low-Rank Adaptation) 🧠⚕️. The primary objective is to adapt a general-purpose large language model to the healthcare domain in a parameter-efficient, reproducible, and resource-aware manner.