Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

feat: Extend the CLI to support granite-docling-vlm-options and max_new_tokens arguments used when the provider is GraniteDocling #164

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
nikos-livathinos wants to merge 8 commits into main
base: main
Choose a base branch
Loading
from nli/granitedocling_vllm

Conversation

Copy link
Contributor

@nikos-livathinos nikos-livathinos commented Oct 15, 2025

This PR extends the CLI to provide arguments for vlm-options and max_new_tokens when the provider is GraniteDocling.

New CLI options:

--granite-docling-vlm-options TEXT Vlm options for GraniteDocling. Supported values: ['granitedocling_mlx',
 'granitedocling_transformers', 'granitedocling_vllm'] 
 [default: granitedocling_transformers] 
--max-new-tokens INTEGER Override the default value of max_new_tokens [default: None] 

... version to 2.56
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
...--granite-docling-vlm-options`,
`--max-new-tokens` and propagate them in the `get_prediction_provider()`
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
Copy link
Contributor

github-actions bot commented Oct 15, 2025
edited
Loading

DCO Check Passed

Thanks @nikos-livathinos, all your commits are properly signed off. 🎉

Copy link

mergify bot commented Oct 15, 2025

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

  • title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\(.+\))?(!)?:

@nikos-livathinos nikos-livathinos marked this pull request as draft October 15, 2025 09:47
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
...e mismatches within a tolerance
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cau-git cau-git Awaiting requested review from cau-git

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

AltStyle によって変換されたページ (->オリジナル) /