This is the repository for the deployment of the prompt processing database, kafka cluster, and knative serving environment for the USDF. It stores the kubernetes manifests, kubernetes operator configurations, and test Kafka producer and consumer code. Deployments are done currently through make files.
See the prompt prototype repo for the prompt prototype code.
To access the kuberentes environment login [here] (https://k8s.slac.stanford.edu/usdf-prompt-processing-dev) to obtain the kubernetes commmands to login and set your context.
Documentation on kafka, knative, and cnpg postgres is here
If performing local deployments below are links to kubectl and kustomize.
kubectl download Kustomize download
kubectl port-forward svc/prometheus-grafana 8080:80 -n prometheus
'kubectl -n kafka run kafka-consumer -ti --image=quay.io/strimzi/kafka:0.33.2-kafka-3.4.0 --rm=true --restart=Never -- bin/kafka-console-consumer.sh --bootstrap-server prompt-processing-kafka-bootstrap:9092 --topic rubin-prompt-processing-prod --from-beginning'
'kubectl get ingresses.networking.internal.knative.dev --all-namespaces'
'kubectl get ksvc --all-namespaces'