Data Engineer
Arena Technical Resources, LLC
Data Engineer
Location: Arlington, US
Job ID: 16366
Job Description
Job
Description:
Title: Data Engineer
Location: On-Site in Arlington, VA
Citizenship/Clearance Requirement: US Citizen with an active TS/SCI Clearance required. This position supports a government contract
Job Description:
Our client is seeking experienced Data Engineers to join their Advana team. As aData Engineer,you will play a crucial role in designing, developing, and maintaining ourAdvanadata infrastructure and systems. Your expertise inETL, DataBricks, Python, Spark, Scala, JavaScript/JSON, SQL,andJupiter Notebookswill be essential in ensuring efficient data processing and analysis.
Job Responsibilities:
- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as DataBricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
- Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
- Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
- Leverage big data technologies to efficiently process and analyze very large datasets, similar to those encountered in a federal agency.
- Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
- Utilize your experience with DoD (Department of Defense) projects to meet specific data requirements and adhere to relevant standards.
- Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
Job Requirements:
- Minimum of 5 years of experience as aData Engineer, with demonstrated experience creatingdata pipelinesfrom scratch.
- Bachelor's degree in a related field.
- High level of proficiency inETL processesand demonstrated hands-on experience with technologies such asDataBricks, Python, Spark, Scala, JavaScript/ JSON, SQL, and Jupyter Notebooks.
- Strong problem-solving skills and ability to solve complex data-related issues.
- Recent DoD or IC-related experience.
- Demonstrated experience working with very large datasets and leveraging big data technologies to process and analyze data efficiently.
- Understanding of data modeling/ visualization, database design principles, and data governance practices.
- Knowledge ofQlik/ Qlik Sense, QVD/ QlikView, and Qlik Production Application Standards (QPAS) is a huge plus.
- Previous experience withAdvanais a plus.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Detail-oriented mindset with a commitment to delivering high-quality results.
Arena Technical Resources, LLC, (ATR) is an Equal Opportunity Employer (EOE) who will provide equal employment opportunity to employees and applicants for employment without regard to race, ethnicity, religion, color, sex, pregnancy, national origin, age, veteran status, ancestry, sexual orientation, gender identity or expression, marital status, family structure, genetic information, or mental or physical disability
An Equal Opportunity
Employer M/F/D/V
Job
CategoryDatabase Admin/Developer
Job
ID16366
Job
Title
Data Engineer
Job
LocationArlington, VA (Pentagon)
Hourly
Pay Rate
-
Annual
Pay Rate
-
#
Required2
Apply
ToMJL@atr.com
Confirm your E-mail: Send Email
All Jobs from Arena Technical Resources, LLC