Data Engineer with Scala
GFT Technologies
What will you do?
As a Data Engineer with Scala, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and compliance with the internal quality levels.
Our Client is focusing on developing a DataHub to store accounting information of different geographical locations. The main goal is to create efficient, user friendly and scalable solutions that could be used by different teams.
Your tasks
You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc. You will use Scrum methodology, and be part of a high performance team You will document your solutions in tools such as JIRA, Confluence, ALM You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery
Your skills
At least 3-4 years of experience in programming Including at least 2 years of experience in Spark with Scala Experience in working with Big Data - Spark, Hadoop, Hive Experience with different database structures (Postgres, SQL, Hive) Continuous Integration (Git, GitHub, Jenkins) Practical knowledge of Agile processes & tooling: Jira, Confluence, Kanban, Scrum etc. Fluent English is a must (both written and spoken)
Nice to have
Azure Databrics CI/CD: Jenkins, Github Actions Orchestration: Control-M, Airflow Python, Bash scripting Management and automation of IT processes with the ControlM tool Software development life cycle Basics of cybersecurity & Quality (SonarQube, and related tools) Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)
We offer you
Working in a highly experienced and dedicated team Contract of employment or B2B contract Hybrid work from Warsaw office – 2 office days per week Competitive salary and extra benefit package that can be tailored to your personal needs (private medical coverage, sport & recreation package, lunch subsidy, life insurance, etc.) On-line training and certifications fit for career path On-line foreign language lessons Social events Access to e-learning platform Ergonomic and functional working space
Confirm your E-mail: Send Email
All Jobs from GFT Technologies