Westlake, TX, US
17 hours ago
Senior Data Engineer

Designs and implements single and multi-tenant applications data processes using data models techniques and database technologies – Snowflake and Azure SQL. Creates Application Program Interfaces (APIs) using SpringBoot and Java. Develops Python scripts to gather data files from scan location and load to Azure MYSQL database, using Extract, Load, Transform (ELT). Develops database triggers to mask sensitive data using SQL and PLSQL in lower environments. Develops database and Python scripts for GitHub to deploy code to higher environments using Continuous Integration/Continuous Deployment (CI/CD) pipelines. 

Primary Responsibilities: 

• Automates the process of dropping files from one LAN location to another by executing the Informatica Workflow. 

• Builds custom databases and middle tiers to support custom web sites. 

• Develops SQL scripts to create database objects — Tables, Views, and Procedures. 

• Analyzes the existing data engineering processes. 

• Proposes new solutions to effectively manage the data and improve security of the applications. 

• Develops frameworks to perform data quality checks and to validate business requirements. 

• Collaborates across different teams to work on a project. 

• Develops and improves data capabilities for software platforms and products. 

• Writes test plans, cases, specifications, and coverage. 

Education and Experience: 

Bachelor’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and three (3) years of experience as a Senior Data Engineer (or closely related occupation) building solutions for extracting and transforming data from diversified sources (Databases, APIs, Web logs, and files) in a financial services domain. 

Or, alternatively, Master’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and one (1) year of experience as a Senior Data Engineer (or closely related occupation) building solutions for extracting and transforming data from diversified sources (Databases, APIs, Web logs, and files) in a financial services domain. 

Skills and Knowledge: 

Candidate must also possess: 

• Demonstrated Expertise (“DE”) building infrastructure for optimal extraction, transformation, and loading of data from data sources, using SQL (Oracle, SQL MI, and MySQL), AWS and Azure big data technologies, and structured/unstructured data from files. 

• DE building tools that use the data pipeline to provide actionable insights into key business performance metrics, using Extract, Transform, and Load (ETL)/ELT tools (Informatica Snaplogic, or AWS Services) on Cloud Data warehouse (Snowflake). 

• DE performing release engineering activities (CI/CD), deploying pipelines, and performing code versioning, using GitHub and BitBucket. 

• DE creating programmatic scripts to extract, transform, and manipulate data, using Python; and creating interactive marketing results dashboards using Business Intelligence (BI) tools — Power BI and Tableau. 

Confirm your E-mail: Send Email