Data Engineer
Kforce
Kforce is seeking a Data Engineer for a large enterprise client. This position will report to the St. Louis or Denver office working 4 days a week in office, 1 day remote.
Overview:
We are seeking a highly skilled and motivated Data Engineer to join our growing team. This role will focus on leveraging cutting-edge technologies to design and build scalable data solutions. The ideal candidate will have a strong background in cloud-driven environments, big data frameworks, and real-time data streaming technologies.
Responsibilities:
* Design, develop, and deploy Spark pipelines from scratch using Scala
* Migrate and process data to the cloud, predominantly on AWS
* Implement and optimize batch processing and real-time streaming solutions, transitioning to a fully real-time environment in AWS
* Utilize Apache Kafka (or AWS Kinesis) for real-time data streaming
* Work with AWS EMR for large-scale data processing
* Develop and manage databases using DynamoDB and other big data tools such as Hive and HBase
* Write and optimize SQL queries, including CTEs (Common Table Expressions) and window functions
* Collaborate with cross-functional teams to ensure seamless data integration and delivery
Confirm your E-mail: Send Email
All Jobs from Kforce