Do you like building complex, secure platforms with a touch of a button? Are passionate about developing automated infrastructure as code that is successfully rolled out across a global implementation? Do you have what it takes to build robust solution that aide data engineers in delivering their data pipelines?
UBS , the Group Compliance & Regulatory Governance (GCRG) Technology team is looking for a hands-on Data Engineer on Azure leveraging Databricks for Scala/Python to:
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using Databricks and Airflow
• craft complex transformation pipelines on multiple datasets producing valuable insights that inform business decisions, making use of our internal data platforms and educate others about Best Practices for analytics big data
• develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems and ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements
• build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues
• leverage Airflow to build complex branching Data Driven pipelines and leverage Databricks to build the spark layer of data pipelines
• leverage Python and Scala for low level complex data operations, codify best practices, methodology and share knowledge with other engineers in UBS