RTP, NC, 27709, USA
1 day ago
Senior Software Engineer - Data Lake
Application window has been extended and is expected to close on January 6, 2025. The job posting may be removed earlier if the position is filled or if a sufficient number of applications are received. We are looking for a highly skilled and experienced Senior Development Engineer to lead the development of our Data Lake project. The ideal candidate will have a deep understanding of data architecture, cloud technologies, and large-scale data processing systems. You will be responsible for designing, building, and optimizing the data lake infrastructure to support our data analytics and business intelligence needs. This role requires a strong focus on scalability, performance, and security in managing vast amounts of structured and unstructured data. What You'll Do Key Responsibilities: * Data Lake Architecture: Design and implement the architecture of the data lake, ensuring it meets the organization's needs for data storage, retrieval, and processing. * Data Integration: Develop and manage ETL/ELT pipelines to ingest data from various sources, ensuring data quality and consistency. * Scalability and Performance: Optimize the data lake for performance and scalability to handle large datasets and complex queries efficiently. * Collaboration: Work closely with data engineers, data scientists, and business stakeholders to understand requirements and deliver solutions that align with business goals. * Security and Compliance: Ensure data security, privacy, and compliance with industry standards and regulations within the data lake environment. * Innovation: Continuously explore new technologies and methodologies to improve the data lake infrastructure and related processes. * Mentorship: Provide technical guidance and mentorship to junior engineers and contribute to the overall growth of the team. Who You Are Minimum Qualifications: * 5+ years of experience in software development and data engineering to include experience building data lakes or large-scale data systems. * Experience with programming languages such as Python, Java or Scala * Experience with big data technologies like Hadoop, Spark, and Apache Kafka * Experience with cloud platforms such as AWS, Azure, or Google Cloud * Experience with data modeling, data warehousing concepts, or data pipeline architecture Preferred Qualifications: * Technical Skills: Experience with Splunk Enterprise Security and Splunk SOAR * Cloud Expertise: Experience with cloud services related to data storage, processing, or analytics (e.g., S3, Redshift, Big Query). * Database Knowledge: Experience with both SQL and NoSQL databases, as well as familiarity with data lake storage formats (e.g., Parquet, ORC, Avro). * Certifications: Relevant certifications in cloud platforms, big data, or data engineering. * Machine Learning Knowledge: Familiarity with integrating data lakes into machine learning workflows and supporting data science teams. * Agile Methodologies: Experience working in Agile or DevOps environments, with a focus on continuous integration and delivery (CI/CD). * Problem-Solving: Excellent analytical and problem-solving skills with the ability to tackle complex data challenges. * Communication: Strong verbal and written communication skills, with the ability to articulate technical concepts to non-technical stakeholders. Why Cisco Secure We're global, we're adaptable, we're diverse, and our security portfolio is as extensive as it is groundbreaking. Have you heard of Threat, Detection & Response, Zero Trust by Duo, Common Services Engineering, or Cloud & Network Security? Those are only a few of our product teams! The only thing we're missing is YOU. Join an enterprise security leader with a start-up culture, committed to driving innovation and giving you the opportunity to make an impact. We #InnovateToWin and we know we're better together, that's why we're dedicated to inclusivity, collaboration, and diversity in everything we do. We're proud to be the Best Small and Mid-Size Enterprises Security Solution Cisco Secure continues to grow and evolve year after year with 100% of Fortune 100 Companies using our products, and we're excited to see the new heights we'll reach with your passion for security, your customer focus, and your desire to change things up! There are so many amazing reasons to join Cisco. Learn more [1] here! #STO25 References Visible links 1. https://www.cisco.com/c/en/us/about/careers/we-are-cisco.html Cisco is an Affirmative Action and Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis. Cisco will consider for employment, on a case by case basis, qualified applicants with arrest and conviction records.
Confirm your E-mail: Send Email