Plano, TX, USA
3 days ago
AWS-EMR PySpark Hadoop Developers
Kforce's client, one of the world's largest financial institutions, is hiring an 6-person scrum team of AWS-EMR PySpark Hadoop Developers in Wilmington (DE), Plano (TX) & New York City (NY). This is an opportunity for quick fulltime employment with Client. Please note Lead, VP Titled, Hands-on Developer will need to be located in Plano, TX (Dallas) and will mentor a team of mobile application and full-stack developers, fostering collaboration and growth. Responsibilities: * Design and implement scalable and efficient data pipelines using AWS and Data Lakehouse Platform services * Leverage AWS cloud services like S3, Kinesis, Redshift, EMR, Glue, Lambda, and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics * Develop and maintain data lakes and data warehouses on AWS and Data Lakehouse Platform, ensuring data integrity and accessibility * Optimize data storage and processing for performance and cost efficiency. * Automate data workflows and ensure high data quality and reliability * Monitor, troubleshoot, and resolve data pipeline issues * Organizing and managing data within the environment, ensuring it is stored efficiently, securely, and in a manner that supports easy access and analysis * Monitor the performance of data processes and queries and optimize efficiency and speed * Ensure high standards of data quality and implement data governance practices * Provide ongoing support for the platform, troubleshoot any issues that arise, and ensure high availability and reliability of data infrastructure * Create documentation for the platform infrastructure and processes, and train other team members or users on the platform effectively * Setup configure, implement, and maintain the data lake and respective tools
Confirm your E-mail: Send Email