Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture.
Key Responsibilities:
Designing, building, and maintaining medallion architecture-based data pipelines in Databricks platforms.
Handling raw data ingestion through Delta Live Tables while ensuring data quality and access latency.
Manage enterprise-level complex data and metadata changes in Databricks environment using delta live tables.
Utilizing knowledge of Snowflake to offer insight into data warehousing and management.
Collaborate with data architects to provide Databricks solutions that align with company objectives.
Work in conjunction with data science teams to implement complex statistical models.
Ensuring data security and compliance in Databricks and Snowflake environments.
Developing and deploying ETL job workflows with an emphasis on automation and scalability.
Keeping up-to-date with industry best practices and emerging trends in Databricks technology.
Requirements:
Bachelor's degree in Computer Science, Information Technology, or a related field
Solid experience in Databricks platform, data engineering, and using Delta Live Tables
Experience with medallion architecture in a data lake environment
Proficiency in Snowflake data warehousing platform
Strong understanding of ETL workflows and data pipeline automation.
Exceptional knowledge of data structures, data modeling, and database schemas
Highly skilled in SQL, Python, or Scala.
Experienced in performance tuning, troubleshooting, and debugging in Databricks environment
Outstanding problem-solving abilities, with an innovative approach to tackling complex challenges.
Exceptional communication skills with proven ability to bridge communication gaps between technical and non-technical stakeholders.
Ideal candidates are proactive, collaborative, and passionate about data and Databricks technologies. If you have a desire to be at the forefront of data innovation, we would like to meet you.
Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture.
Key Responsibilities:
Designing, building, and maintaining medallion architecture-based data pipelines in Databricks platforms.
Handling raw data ingestion through Delta Live Tables while ensuring data quality and access latency.
Manage enterprise-level complex data and metadata changes in Databricks environment using delta live tables.
Utilizing knowledge of Snowflake to offer insight into data warehousing and management.
Collaborate with data architects to provide Databricks solutions that align with company objectives.
Work in conjunction with data science teams to implement complex statistical models.
Ensuring data security and compliance in Databricks and Snowflake environments.
Developing and deploying ETL job workflows with an emphasis on automation and scalability.
Keeping up-to-date with industry best practices and emerging trends in Databricks technology.
Requirements:
Bachelor's degree in Computer Science, Information Technology, or a related field
Solid experience in Databricks platform, data engineering, and using Delta Live Tables
Experience with medallion architecture in a data lake environment
Proficiency in Snowflake data warehousing platform
Strong understanding of ETL workflows and data pipeline automation.
Exceptional knowledge of data structures, data modeling, and database schemas
Highly skilled in SQL, Python, or Scala.
Experienced in performance tuning, troubleshooting, and debugging in Databricks environment
Outstanding problem-solving abilities, with an innovative approach to tackling complex challenges.
Exceptional communication skills with proven ability to bridge communication gaps between technical and non-technical stakeholders.
Ideal candidates are proactive, collaborative, and passionate about data and Databricks technologies. If you have a desire to be at the forefront of data innovation, we would like to meet you.