-
Notifications
You must be signed in to change notification settings - Fork 37
Open
@edwardelric1202
Description
Hi, Can you give some advice about how to inference finetuned Starcoder model with this code? Since lora finetune changed some of layers of the model, some of the code in starcoder.cpp should be changed, how can I use this code to inference with my finetuned Starcoder model?