About Team and Position Summary:
The Senior Data Engineer will be a part of a dynamic and innovative data engineering team responsible for the design, development, and maintenance of the company's data infrastructure. This team is at the forefront of advancing the company's data capabilities and plays a crucial role in ensuring that the organization can leverage data to drive business decisions and growth. This role requires a highly experienced individual with a deep understanding of data systems and processes, as well as the ability to work collaboratively within a team and across departments. The Senior Data Engineer will also be responsible for mentoring junior engineers and contributing to the continuous improvement of the team's processes and capabilities.
Key Responsibilities:
1. Designing, constructing, installing, testing, and maintaining highly scalable data management systems.
2. Ensuring systems meet business requirements and industry practices.
3. Integrating up-and-coming data management and software engineering technologies into existing data structures.
4. Developing set processes for data mining, data modelling, and data production.
5. Collaborating with data scientists and architects on several projects.
6. Conducting complex data analysis and report results.
7. Providing technical leadership and support to the data team.
8. Working on improving data reliability, efficiency, and quality.
9. Developing and implementing data standards and common data elements when needed.
10. Monitoring analytics and metrics results.
11. Mentoring and guiding junior data engineers in their work.
12. Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
13. Ensuring data security and compliance with relevant regulations.
14. Working with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Key Challenges and Opportunities
1. Data Complexity: Managing complex and large datasets, transforming them into a format that can be easily analyzed, can be a significant challenge.
2. Data Quality: Ensuring the quality and accuracy of data is another major challenge. The Senior Data Engineer must implement robust processes and systems to identify and correct any inaccuracies.
3. Data Security: Protecting sensitive data from breaches and ensuring compliance with data protection regulations can be a tricky task.
4. Rapidly Changing Technologies: The technology landscape changes quickly, and keeping up with new tools and techniques is a constant challenge.
5. Skill Gap: As a senior member of the team, there might be a need to mentor or guide junior data engineers who might lack the necessary skills or experience. This can be time-consuming.
Opportunities:
1. Advanced Technologies: The rise of AI and machine learning presents a great opportunity for Senior Data Engineers to develop sophisticated data systems and models.
2. Increased Demand for Data: As businesses become more data-driven, there is a growing demand for skilled data engineers, leading to numerous career advancement opportunities.
3. Strategic Influence: As a Senior Data Engineer, there's an opportunity to influence strategic decisions by providing insights from data.
4. Skill Development: The role provides plenty of opportunities for learning and development, particularly in areas such as cloud technologies, big data platforms, and advanced analytics.
5. Innovation: Given the nature of the role, there's a lot of scope for innovation in developing new methods for data processing and analysis.
What you'll bring:
1. Extensive Experience: As a Senior Data Engineer, you should bring 7+ years of experience in data engineering, data science, or in a related field.
2. Technical Proficiency: You should have a strong background in SQL, Python, Java, or other programming languages, as well as experience with big data tools and platforms like Hadoop, Spark, or Kafka.
3. Knowledge of Data Warehousing: You should bring knowledge of data warehousing and ETL tools, and an understanding of data architecture, infrastructure, and distributed computing.
4. Expertise in Data Modeling: You should be adept at data modeling and able to design, build, and manage relational and non-relational databases.
5. Strong Analytical Skills: As a senior data engineer, you should possess strong analytical skills to work with large amounts of data and provide insights.
6. Problem-Solving Ability: You'll need a strong problem-solving ability to overcome the challenges associated with dealing with complex data.
7. Leadership Skills: As a senior member of the team, you should bring leadership skills to guide and mentor junior data engineers.
8. Knowledge of Data Privacy Regulations: You should be familiar with data privacy regulations and best practices to ensure that data is handled securely and responsibly.
9. Project Management Skills: You should bring strong project management skills, including the ability to manage multiple projects concurrently and meet deadlines.
10. Communication Skills: You should have excellent communication skills to collaborate with different stakeholders and explain complex technical concepts in a clear and understandable way.
About Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered.
We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.
Flexible, hybrid work
We use a hybrid way of working with primary in office presence coupled with an optimal mix of virtual presence. We use our campuses to collaborate and be together in person, as business needs require and for development and networking opportunities. This approach helps us make quicker decisions, remove location barriers across our global team, be more flexible in our personal lives.
Benefits
Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.
Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Minimum Qualifications:Option 1: Bachelor's degree in Computer Science and 3 years' experience in software engineering or related field. Option 2: 5 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science and 1 year's experience in software engineering or related field. 2 years' experience in data engineering, database engineering, business intelligence, or business analytics.Preferred Qualifications...Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.
Primary Location...Pardhanani Wilshire Ii, Cessna Business Park, Kadubeesanahalli Village, Varthur Hobli , India