As a global leader in combining people and technology to help companies realise the disruptive potential of AI, CloudFactory is seeking highly skilled and experienced Senior Data Engineers to join our dynamic team to help mature our data platform.

You will have the opportunity to work with cutting-edge technologies and collaborate with a diverse and talented team to scale our data processing capabilities, whilst creating economic opportunities for talented individuals in developing nations.

Whilst we offer remote work flexibility, we expect this role to be office-based two days a week.

Responsibilities

The successful candidate will translate user requirements into actionable insights by leveraging existing tools and technologies. Your responsibilities will include: 

Regular interaction with PMs/stakeholders to understand their requirements Investigation to ascertain if the requirements can be met using existing technology and data resources Data extraction using Python and other tools like Fivetran Data modelling using SQL and the concept of Star and Snowflake schema Assisting in cost and performance optimization choices within the data warehouse.  Communicating reasoning and logic behind opinions to help make optimal choices Write data quality and other metadata collection systems within data pipelines to promote observability and recoverability of pipelines Write unit and integration tests to bolster system reliability Proactively identify the areas of improvement, propose solutions and manage technical debt Mentoring, guiding and line management of three/four team members. Tech Stack

Our tech stack:

Data extraction and orchestration tools - Fivetran, Prefect Data modelling tool - DBT Data Warehouse - Snowflake Data quality cheeks - dbt, Elementary Data visualisation - Tableau and Quicksight Data catalogue and lineage - Atlan, dbt Source code management - Github Infrastructure as Code - Terraform, Cloudformation Programming Language - Python AWS services (ECS, S3)
Interview Process

Candidates will be expected to complete an initial coding and analytical thinking test, followed by an interview with Data Architect and Senior Product Manager where they will be expected to talk through previous projects, including approaches taken and results achieved. 

Successful candidates will then meet with the Engineering Director before a final interview with the CTO.

The process is expected to take 1-2 weeks.