You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add Install Gateway section in Getting Started Latest guide
- Move instructions from the Deploy an Inference Gateway section describing installation of Gateway API CRDs and provider specific GWs
Signed-off-by: Dharaneeshwaran Ravichandran <[email protected]>
### Deploy the InferencePool and Endpoint Picker Extension
46
+
### Install the Gateway
45
47
46
-
Install an InferencePool named `vllm-llama3-8b-instruct` that selects from endpoints with label `app: vllm-llama3-8b-instruct` and listening on port 8000. The Helm install command automatically installs the endpoint-picker, InferencePool along with provider specific resources.
48
+
Choose one of the following options to install Gateway.
47
49
48
-
Set the chart version and then select a tab to follow the provider-specific instructions.
50
+
=== "GKE"
49
51
50
-
```bash
51
-
export IGW_CHART_VERSION=v0
52
-
```
52
+
Nothing to install here, you can move to the next [section](#deploy-the-inferencepool-and-endpoint-picker-extension)
53
53
54
-
--8<-- "site-src/_includes/epp-latest.md"
54
+
=== "Istio"
55
55
56
-
### Deploy an Inference Gateway
56
+
1. Requirements
57
+
- Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
57
58
58
-
Choose one of the following options to deploy an Inference Gateway.
### Deploy the InferencePool and Endpoint Picker Extension
92
97
93
-
Please note that this feature is currently in an experimental phase and is not intended for production use.
94
-
The implementation and user experience are subject to changes as we continue to iterate on this project.
98
+
Install an InferencePool named `vllm-llama3-8b-instruct` that selects from endpoints with label `app: vllm-llama3-8b-instruct` and listening on port 8000. The Helm install command automatically installs the endpoint-picker, InferencePool along with provider specific resources.
95
99
96
-
1. Requirements
100
+
Set the chart version and then select a tab to follow the provider-specific instructions.
97
101
98
-
- Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.
0 commit comments