Resource quota aware kubernetes pod operator

[mrrsm]

Description

If KubernetesPodOperators were resource quota aware the proper intent could be provided so the task could be queued/retried rather then always failing.

Use case/motivation

Sometimes I will have too many dags kick off that spin up pods and I will hit my quota, rather then having my runs fail I would prefer if that task was just queued until the quota frees up as I know this will happen "soon".

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[raphaelauv]

you can use KubernetesCreateResourceOperator and KubernetesDeleteResourceOperator

for managing https://github.com/kubernetes-sigs/kueue or Volcano jobs

if you need a sensor create a k8sressourcesensor