Python, PySpark, SQL, Hadoop, Hive, CI/CD, ability to use AI and LLM for development, testing, efficiency improvements, deployments, optimization, etc.. Automation, distributed processing, able to work with API’s and pull data from sources using it. Knowledge and experience of Data Governance, DataQuality and tools like DataHub, Great Expectations, etc...
Python, PySpark, SQL, Hadoop, Hive, CI/CD, ability to use AI and LLM for development, testing, efficiency improvements, deployments, optimization, etc.. Automation, distributed processing, able to work with API’s and pull data from sources using it. Knowledge and experience of Data Governance, DataQuality and tools like DataHub, Great Expectations, etc...
Python, PySpark, SQL, Hadoop, Hive, CI/CD, ability to use AI and LLM for development, testing, efficiency improvements, deployments, optimization, etc.. Automation, distributed processing, able to work with API’s and pull data from sources using it. Knowledge and experience of Data Governance, DataQuality and tools like DataHub, Great Expectations, etc...