Consolidate Kubeflow tests (kubeflow#2805)

* Training operator CICD improvements (kubeflow#2779) * Add the networkpolicies Signed-off-by: juliusvonkohout <[email protected]> * rework the training operator tests Signed-off-by: juliusvonkohout <[email protected]> * fix the comments Signed-off-by: juliusvonkohout <[email protected]> * fix filename Signed-off-by: juliusvonkohout <[email protected]> * try to fix the permissions Signed-off-by: juliusvonkohout <[email protected]> * try to fix the permissions Signed-off-by: juliusvonkohout <[email protected]> * change to the user namespace Signed-off-by: juliusvonkohout <[email protected]> * update the image to rc.1 Signed-off-by: juliusvonkohout <[email protected]> * fixes Signed-off-by: juliusvonkohout <[email protected]> * fixes Signed-off-by: juliusvonkohout <[email protected]> * fixes Signed-off-by: juliusvonkohout <[email protected]> * fixes Signed-off-by: juliusvonkohout <[email protected]> * fixes Signed-off-by: juliusvonkohout <[email protected]> --------- Signed-off-by: juliusvonkohout <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * create seperate file for install_KinD_create_KinD_cluster_install_kustomize.sh to avoid code repitition Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * make sh file executable Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * remove reduntant codes Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * combine kind, kuztomize and kind-cluster create sh files into one file Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * fix issues with combined file Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * fix configurations issues Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * fix linting issues in workflow files Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * fix trailing issues in workflow files Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * fix trailing issues in workflow file bentoml Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * made tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh executable and removed chmod command from the workflow files Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * made modifications in workflow files Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * deleted redundant files from tests folder Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * Add kustomize installation file Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * made install_kustomize.sh file executable Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * made a fix Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * fix issue with linting of YAML files (kubeflow#2825) * fix issue with linting of YAML files Signed-off-by: hansinikarunarathne <[email protected]> * delete a file to check the functionality Signed-off-by: hansinikarunarathne <[email protected]> * Add the after checking the functionality Signed-off-by: hansinikarunarathne <[email protected]> * Add folders to yaml linting Signed-off-by: hansinikarunarathne <[email protected]> * check linting issues Signed-off-by: hansinikarunarathne <[email protected]> * check linting issues Signed-off-by: hansinikarunarathne <[email protected]> * check linting changes Signed-off-by: hansinikarunarathne <[email protected]> * check linting functionality by chnaging different files Signed-off-by: hansinikarunarathne <[email protected]> * made some fixes in linting YAML file Signed-off-by: hansinikarunarathne <[email protected]> * made some fixes in linting YAML file Signed-off-by: hansinikarunarathne <[email protected]> * made some fixes in linting YAML file and check the functionality Signed-off-by: hansinikarunarathne <[email protected]> * made some fixes in linting YAML file and check the functionality Signed-off-by: hansinikarunarathne <[email protected]> * Add github, hack and tests folders also for linting Signed-off-by: hansinikarunarathne <[email protected]> * Check functionality by deleting sh from hack and yaml file common Signed-off-by: hansinikarunarathne <[email protected]> * Added deleted files Signed-off-by: hansinikarunarathne <[email protected]> --------- Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * Expose Ray and Seldon to example kustomization.yaml file (kubeflow#2834) * Expose Ray and Seldon to example kustomization.yaml file Signed-off-by: hansinikarunarathne <[email protected]> * Add internal documentations for ray and seldon Signed-off-by: hansinikarunarathne <[email protected]> --------- Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * Increase the time out of notebook and katib test Signed-off-by: hansinikarunarathne <[email protected]> * increase the timout time Signed-off-by: hansinikarunarathne <[email protected]> * increase timeout of the create pipeline Run from Kubeflow Notebook to 2400s Signed-off-by: hansinikarunarathne <[email protected]> * Add code to calculate time taken to pull a docker image Signed-off-by: hansinikarunarathne <[email protected]> * fix syntax error in yaml file Signed-off-by: hansinikarunarathne <[email protected]> * increase pipeline time Signed-off-by: hansinikarunarathne <[email protected]> * remove one step in action Signed-off-by: hansinikarunarathne <[email protected]> * Added tests to tests/gh-actions to enable baseline and restricted PSS (kubeflow#2819) * Patched PSS labels to multi_tenancy Signed-off-by: biswajit-9776 <[email protected]> * Added script in gh-actions to patch PSS/static/baseline/pacthes Signed-off-by: biswajit-9776 <[email protected]> * Added PSS scripts for both baseline and restricted labels of static namespaces and renamed directories Signed-off-by: biswajit-9776 <[email protected]> * Added tests to enable PSS in gh-actions Signed-off-by: biswajit-9776 <[email protected]> * Added workflow test for PSS labels Signed-off-by: biswajit-9776 <[email protected]> * Fixed indentation Signed-off-by: biswajit-9776 <[email protected]> --------- Signed-off-by: biswajit-9776 <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> * add kind cluster step into pss test yaml file Signed-off-by: hansinikarunarathne <[email protected]> * change time pot time Signed-off-by: hansinikarunarathne <[email protected]> --------- Signed-off-by: juliusvonkohout <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: hansinikarunarathne <[email protected]> Signed-off-by: biswajit-9776 <[email protected]> Co-authored-by: Julius von Kohout <[email protected]> Co-authored-by: biswajit-9776 <[email protected]>
hansinikarunarathne · Aug 26, 2024 · 8e0135b · 8e0135b
1 parent 37a86f9
commit 8e0135b
Show file tree

Hide file tree

Showing 27 changed files with 143 additions and 297 deletions.
diff --git a/.github/workflows/admission_webhook_test.yaml b/.github/workflows/admission_webhook_test.yaml
@@ -2,11 +2,9 @@ name: Build & Apply PodDefaults manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/admission_webhook_test.yaml
     - apps/admission-webhook/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -18,14 +16,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

diff --git a/.github/workflows/bentoml_test.yaml b/.github/workflows/bentoml_test.yaml
@@ -2,10 +2,8 @@ name: Build & Apply BentoML Yatai Stack manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/bentoml_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
     - contrib/bentoml/**
@@ -17,14 +15,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install cert-manager
       run: ./tests/gh-actions/install_cert_manager.sh

diff --git a/.github/workflows/centraldashboard_test.yaml b/.github/workflows/centraldashboard_test.yaml
@@ -2,11 +2,9 @@ name: Build & Apply CentralDashboard manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/centraldashboard_test.yaml
     - apps/centraldashboard/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
 
 jobs:
@@ -16,14 +14,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

diff --git a/.github/workflows/dex_test.yaml b/.github/workflows/dex_test.yaml
@@ -2,11 +2,9 @@ name: Build & Apply Dex manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/dex_test.yaml
     - common/dex/base/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
 
 jobs:
@@ -16,14 +14,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

diff --git a/.github/workflows/jupyter_web_application_test.yaml b/.github/workflows/jupyter_web_application_test.yaml
@@ -2,11 +2,9 @@ name: Build & Apply JWA manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/jupyter_web_application_test.yaml
     - apps/jupyter/jupyter-web-app/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
 
 jobs:
@@ -16,14 +14,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

diff --git a/.github/workflows/katib_test.yaml b/.github/workflows/katib_test.yaml
@@ -2,11 +2,9 @@ name: Build & Apply Katib manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/katib_test.yaml
     - apps/katib/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -18,14 +16,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh
@@ -57,7 +49,7 @@ jobs:
         kubectl wait --for=condition=Running experiments.kubeflow.org -n kubeflow-user --all --timeout 300s
 
         echo "Waiting for all Trials to become Succeeded..."
-        kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 300s
+        kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 1200s
 
         echo "Waiting for the Experiment to become Succeeded..."
         kubectl wait --for=condition=Succeeded experiments.kubeflow.org -n kubeflow-user --all --timeout 300s
diff --git a/.github/workflows/kserve_cni_test.yaml b/.github/workflows/kserve_cni_test.yaml
@@ -2,10 +2,8 @@ name: Build & Apply KServe manifests in KinD, using istio CNI
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/kserve_cni_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - common/istio-cni-1-22/**
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -20,14 +18,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

diff --git a/.github/workflows/kserve_m2m_test.yaml b/.github/workflows/kserve_m2m_test.yaml
@@ -2,12 +2,10 @@ name: Deploy and test KServe with m2m auth in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/kserve_m2m_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - contrib/kserve/**
-    - common/oauth2-proxy/**
+    - common/oidc-client/oauth2-proxy/**
     - common/istio*/**
     - tests/gh-actions/install_istio_with_ext_auth.sh*
     - tests/gh-actions/install_cert_manager.sh
@@ -23,18 +21,12 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install kubectl
       run: ./tests/gh-actions/install_kubectl.sh
 
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
-
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
 

diff --git a/.github/workflows/kserve_test.yaml b/.github/workflows/kserve_test.yaml
@@ -2,10 +2,8 @@ name: Build & Apply KServe manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/kserve_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - contrib/kserve/**
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -20,14 +18,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

diff --git a/.github/workflows/metacontroller_test.yaml b/.github/workflows/metacontroller_test.yaml
@@ -2,10 +2,8 @@ name: Build & Apply contrib/metacontroller in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/metacontroller_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - contrib/metacontroller/**
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -19,14 +17,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config ./tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

diff --git a/.github/workflows/model_registry_test.yaml b/.github/workflows/model_registry_test.yaml
@@ -4,9 +4,8 @@ name: Deploy and test Kubeflow Model Registry
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - apps/model-registry/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
     - common/istio*/**
 
@@ -17,18 +16,12 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install kubectl
       run: ./tests/gh-actions/install_kubectl.sh
 
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
-
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
 

diff --git a/.github/workflows/notebook_controller_m2m_test.yaml b/.github/workflows/notebook_controller_m2m_test.yaml
@@ -2,12 +2,10 @@ name: Test Notebook Controller with m2m auth manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/notebook_controller_m2m_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - apps/jupyter/**
-    - common/oauth2-proxy/**
+    - common/oidc-client/oauth2-proxy/**
     - common/istio*/**
     - tests/gh-actions/install_istio_with_ext_auth.sh*
     - tests/gh-actions/install_multi_tenancy.sh
@@ -19,18 +17,12 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install kubectl
       run: ./tests/gh-actions/install_kubectl.sh
 
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
-
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -