Using AI powered Automation for High Performance Data Pipelines in the Cloud