Interface LlmUtilityServiceGrpc.AsyncService (1.35.0)
Stay organized with collections
Save and categorize content based on your preferences.
publicstaticinterface LlmUtilityServiceGrpc.AsyncServiceService for LLM related utility functions.
Methods
computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)
publicdefaultvoidcomputeTokens(ComputeTokensRequestrequest,StreamObserver<ComputeTokensResponse>responseObserver)Return a list of tokens based on the input text.
| Parameters | |
|---|---|
| Name | Description |
request |
ComputeTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<ComputeTokensResponse> |
countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)
publicdefaultvoidcountTokens(CountTokensRequestrequest,StreamObserver<CountTokensResponse>responseObserver)Perform a token counting.
| Parameters | |
|---|---|
| Name | Description |
request |
CountTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<CountTokensResponse> |