Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Support Cross-Deployment Metadata Sharing #668

Open
a13zen opened this issue Jul 29, 2024 · 1 comment
Open

[FEATURE] Support Cross-Deployment Metadata Sharing #668

a13zen opened this issue Jul 29, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@a13zen
Copy link
Contributor

a13zen commented Jul 29, 2024

Is your feature request related to a problem? Please describe.
Support metadata export/import across deployments. If users can import/export metadata across deployments, they can have shared resources such as EKS/Airflow/Buckets etc that don't need to be namespace specific in one deployment, and then they can import and use the shared resources in their namespace deployment.

This would also allow reducing the overall Role footprint as users don't need to deploy copies of the shared resources. It would also allow reducing costs while still supporting namespaces.

Describe the solution you'd like

  • Support importing metadata across seedfarmer deployments etc.
  - name: EKS_CLUSTER_NAME
    valueFrom:
      moduleMetadata:
        deployment: "shared-eks-cluster" <----- NEW
        group: eks
        name: shared-cluster
        key: ClusterName

Dependency management can be completely manual. If the target entry in SSM doesn't exist. FAIL the deployment of the module depending on it (can be checked during validation). If the value in SSM is garbage, or out of date, that is up to the end user to ensure they deploy dependencies in the correct order.

@dgraeber
Copy link
Contributor

dgraeber commented Jul 29, 2024

@a13zen We will evaluate this request and review our dependency management schemes. Our primary concern here is deleting dependency modules. The concept of a forceDependencyRedeploy will need to be limited in scope to a single deployment, so the manual management is indeed something to be aware of.

@dgraeber dgraeber self-assigned this Jul 29, 2024
@dgraeber dgraeber removed their assignment Oct 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants