Why We Work at Dun & BradstreetDun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,000+ global team members are passionate about what we do. We are dedicated to helping clients turn uncertainty into confidence, risk into opportunity and potential into prosperity. Bold and diverse thinkers are always welcome. Come join us! Learn more at .
The Role:  
As a Data Engineer, you will play a pivotal role in an agile team, working hands-on to transform raw data into impactful end products. Your focus will be on building and optimizing Databricks SQL notebooks, developing scalable workflows, and ensuring data quality compliance to meet dynamic business requirements.Key Responsibilities :Design, build, and optimize data pipelines using Databricks for efficient big data processing.Create and maintain Databricks SQL notebooks to support data analysis and transformation.Develop and deploy Python-based AWS Lambda functions for data automation and processing.Integrate and process large datasets from diverse sources with a focus on reliability and scalability.Collaborate with cross-functional teams to deliver data-driven insights and solutions.Monitor, troubleshoot, and optimize data workflows to ensure performance and reliability.Implement and uphold best practices in data engineering, including code versioning and rigorous testing.Ensure adherence to data governance frameworks and compliance standards.Key Requirements :3+ years of hands-on experience in data engineering with expertise in Databricks and Python.Proficiency in developing and deploying Python-based AWS Lambda functions.Strong knowledge of SQL for data manipulation, analysis, and workflow optimization.Proven experience in building and managing scalable ETL pipelines on Databricks.Familiarity with AWS services, including S3, Lambda, and related tools.Solid understanding of data modelling, partitioning, and performance tuning in Databricks.Experience working in agile environments using SCRUM methodologies.All Dun & Bradstreet job postings can be found at and . Official communication from Dun & Bradstreet will come from an email address ending in @dnb.com.
Notice to Applicants: Please be advised that this job posting page is hosted and powered by Lever. Your use of this page is subject to Lever's and , which governs the processing of visitor data on this platform.