Skip to content

Commit

Permalink
add ollama-operator in example
Browse files Browse the repository at this point in the history
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
  • Loading branch information
panpan0000 committed May 10, 2024
1 parent 23d2340 commit 84da3a3
Showing 1 changed file with 28 additions and 0 deletions.
28 changes: 28 additions & 0 deletions examples/kubernetes-operator/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
# Deploy Ollama to Kubernetes Operator


### Prerequisites

- Install [Ollama-operator](https://github.com/nekomeowww/ollama-operator)

### Steps

1. create a `Model` CR, serving model `phi` as an example:

```
kubectl apply -f - << EOF
apiVersion: ollama.ayaka.io/v1
kind: Model
metadata:
name: phi
spec:
image: phi
EOF
```

2. forward the ports to access the model outside cluster:
```
kubectl port-forward svc/ollama-model-phi ollama
```

3. Install [ollama cli](https://github.com/ollama/ollama) and interact with the model with either API or ollama CLI( e.g. `ollama run phi` ).

0 comments on commit 84da3a3

Please sign in to comment.