Data Engineer

Key Responsibilities:

Proven experience in Data Engineer using Lakehouse/Medallion architecture. Design and develop scalable data processing systems using technologies such as Azure Databricks and Snowflake.  Build and maintain data pipelines to ingest, transform, and distribute data from various sources into the data Lakehouse. Perform data profiling and analysis to identify data quality issues and provide recommendations for improvement. Collaborate with BA/DA and Business users to understand the requirements. Optimize data infrastructure for performance and efficiency. Identify opportunities for optimization and automation and implement them to streamline data processes. Collaborate with cross-functional teams to implement data-related solutions and achieve business objectives.

Requirements:

4+ years of experience in Data Engineering.  Expertise in Azure Databricks and Azure cloud platform Good to have programming skills in Python. Proficiency in SQL and working with relational databases. Experience in working Snowflake database. Good to have Experience with Data modeling and schema design. Knowledge of distributed computing frameworks and data warehousing concepts. Strong problem-solving and troubleshooting skills. Excellent communication and collaboration skills.

 

Technical Stack:

Data bricks, Snowflake, Data Warehouse concepts, ETL

Data Engineer

Key Responsibilities:

Proven experience in Data Engineer using Lakehouse/Medallion architecture.Design and develop scalable data processing systems using technologies such as Azure Databricks and Snowflake. Build and maintain data pipelines to ingest, transform, and distribute data from various sources into the data Lakehouse.Perform data profiling and analysis to identify data quality issues and provide recommendations for improvement.Collaborate with BA/DA and Business users to understand the requirements.Optimize data infrastructure for performance and efficiency.Identify opportunities for optimization and automation and implement them to streamline data processes.Collaborate with cross-functional teams to implement data-related solutions and achieve business objectives.

Requirements:

4+ years of experience in Data Engineering. Expertise in Azure Databricks and Azure cloud platformGood to have programming skills in Python.Proficiency in SQL and working with relational databases.Experience in working Snowflake database.Good to have Experience with Data modeling and schema design.Knowledge of distributed computing frameworks and data warehousing concepts.Strong problem-solving and troubleshooting skills.Excellent communication and collaboration skills.

 

Technical Stack:

Data bricks, Snowflake, Data Warehouse concepts, ETL