Interface SpeculativeDecodingSpecOrBuilder (1.35.0)
Stay organized with collections
Save and categorize content based on your preferences.
publicinterface SpeculativeDecodingSpecOrBuilderextendsMessageOrBuilderImplements
MessageOrBuilderMethods
getDraftModelSpeculation()
publicabstractSpeculativeDecodingSpec.DraftModelSpeculationgetDraftModelSpeculation()draft model speculation.
.google.cloud.vertexai.v1.SpeculativeDecodingSpec.DraftModelSpeculation draft_model_speculation = 2;
| Returns | |
|---|---|
| Type | Description |
SpeculativeDecodingSpec.DraftModelSpeculation |
The draftModelSpeculation. |
getDraftModelSpeculationOrBuilder()
publicabstractSpeculativeDecodingSpec.DraftModelSpeculationOrBuildergetDraftModelSpeculationOrBuilder()draft model speculation.
.google.cloud.vertexai.v1.SpeculativeDecodingSpec.DraftModelSpeculation draft_model_speculation = 2;
| Returns | |
|---|---|
| Type | Description |
SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder |
|
getNgramSpeculation()
publicabstractSpeculativeDecodingSpec.NgramSpeculationgetNgramSpeculation()N-Gram speculation.
.google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation ngram_speculation = 3;
| Returns | |
|---|---|
| Type | Description |
SpeculativeDecodingSpec.NgramSpeculation |
The ngramSpeculation. |
getNgramSpeculationOrBuilder()
publicabstractSpeculativeDecodingSpec.NgramSpeculationOrBuildergetNgramSpeculationOrBuilder()N-Gram speculation.
.google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation ngram_speculation = 3;
| Returns | |
|---|---|
| Type | Description |
SpeculativeDecodingSpec.NgramSpeculationOrBuilder |
|
getSpeculationCase()
publicabstractSpeculativeDecodingSpec.SpeculationCasegetSpeculationCase()| Returns | |
|---|---|
| Type | Description |
SpeculativeDecodingSpec.SpeculationCase |
|
getSpeculativeTokenCount()
publicabstractintgetSpeculativeTokenCount()The number of speculative tokens to generate at each step.
int32 speculative_token_count = 1;
| Returns | |
|---|---|
| Type | Description |
int |
The speculativeTokenCount. |
hasDraftModelSpeculation()
publicabstractbooleanhasDraftModelSpeculation()draft model speculation.
.google.cloud.vertexai.v1.SpeculativeDecodingSpec.DraftModelSpeculation draft_model_speculation = 2;
| Returns | |
|---|---|
| Type | Description |
boolean |
Whether the draftModelSpeculation field is set. |
hasNgramSpeculation()
publicabstractbooleanhasNgramSpeculation()N-Gram speculation.
.google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation ngram_speculation = 3;
| Returns | |
|---|---|
| Type | Description |
boolean |
Whether the ngramSpeculation field is set. |