Job description - Required skills
• Senior AWS Cloud Data Engineer having more than 5+ yrs. of experience.
• Good experience in data engineering to create pipelines for various clients to build end to end solutions using distributed computing frameworks and ETL tools.
• Have good experience and expertise in Python, Pyspark, SQL, AWS, Data warehousing, shell scripting, Bigdata components.
• Experience with building Python Code Libraries (reusable components)
• Experienced working in AWS cloud computing platform using which the complete pipeline was built with toolsets such as Databricks, Glue, EMR, Redshift, RDS, Lambda, DynamoDB, EC2, S3, Airflow, SNS, SQS, experienced in building pipelines for clients using Glue using glue studio and applied custom transformation based on the business needs.
• Good knowledge in SQL to write complex queries in order to achieve client’s requirements.
• Good knowledge in creating lambda functions which have various trigger resources and events triggers with notification to stakeholders using SNS.
• Worked in VCS such as GitHub and bitbucket for maintain and managing the code versions.
• Good experience in dealing with SCD data with the incremental loads to accommodate updated to the data.
• Good exposure to cost optimization to implement best optimized method with lesser cost .
• Good knowledge about data modeling techniques (3NF, Dimensional Modelling, Data Vault).
• Good knowledge about agile, scrum way of working.
Primary Skill : AWS, Python, SW version control and branching
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team—one of the largest IT and business consulting services firms in the world.