Prefix and the examples demonstrating the GRPC client are named withĪ simple_grpc_ prefix. The Python examplesĭemonstrating the HTTP/REST client are named with a simple_http_
#HTTP CLIENT PYTHON HOW TO#
Show how to use the Python library to communicate with Triton to HTTP/REST client are named with a simple_http_ prefix and theĮxamples demonstrating the GRPC client are named with a How to use the C++ library to communicate with Triton to perform That uses the C++ or Python client library to execute imageĬlassification models on Triton. Many of these examples use models from the example modelĬ++ and Python versions of image_client, an example application There are also many example applications that show how to use these The Java and Scala programming languages.Īn example with JavaScript programming language. See src/grpc_generated/java for an example for.
See src/grpc_generated/go for an example for the.For now, only a limited feature subset is supported.Ĭan generate a GRPC API in a large number of programming That makes it easy to communicate with Triton from your Java application Java API (contributed by Alibaba Cloud PAI Team) Memory for passing inputs to and receiving outputs from Triton. These libraries also support using system and CUDA shared Health, statistics and metrics, model repository management,Įtc. Triton to access all its capabilities: inferencing, status and These libraries you can send either HTTP/REST or GRPC requests to Ask questions or report problems in the main Triton issuesĬommunicate with Triton from your C++ or Python application. Several client libraries and examples of how to use those
To simplify communication with Triton, the Triton project provides
0 kommentar(er)
