Roadmap

Horizontal Scaling on K8s for Datahub

Is your feature request related to a problem? Please describe.

We deployed our Datahub on K8s and are about to launch it for the entire company, so we want to scale our cluster in order to avoid any slowness or downtime.

Describe the solution you'd like

Increasing the number of pods should increase our overall cluster by using a load balancer approach. Scaling horizontal is cheaper than vertical.

Describe alternatives you've considered

I know scaling up is possible, and we solved our problem by increasing the CPU and Ram available for our system, but scaling horizontally would be cheaper for larger deployments.

Additional context

The usage of K8s is only growing, supporting this feature would make your tool more prepared for the upcoming years.