Job Description The Data Engineer will be responsible for real-time data development of a data application that is client facing to retail customers. You will utilize SQL, Spark and Python for batch processing and develop Microservices using Python, Kafka, Kubernetes containers. The data engineer will work through 30+ pipelines and rules to ensure communications go to the correct personnel. You will work closely with teammates both onshore and offshore, so an eagerness to collaborate and mentor others is required for this role! Responsibilities: Collaborate with business partners to identify opportunities to leverage big data and/or real-time data technologies in support of Pharmacy Personalization with a common set of tools and infrastructure to make analytics faster, more insightful, and more efficient Design highly scalable and extensible Big Data and/or real-time data platforms which enables collection, storage, modeling, and analysis of massive data sets from numerous channels Define and maintain data architecture, focusing on applying technology to enable business solutions Assess and provide recommendations on business relevance, with appropriate timing and deployment Perform architecture design, data modeling, and implement CVS Big Data and/or real-time data platforms and analytic applications Bring a DevOps mindset to enable big data and batch/real-time analytical solutions that leverage emerging technologies Develop prototypes and proof of concepts for the selected solutions, and implement complex big data and/or real-time data projects Apply a creative mindset with a focus on collecting, parsing, managing, and automating data feedback loops in support of business innovation Compensation: $55-65/hour Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .     To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Skills and Requirements Strong in SQL and Python, with 3+ years hands-on coding experience with both Experience building automated big data pipelines Experience with REST API/Microservice development using Python Experience with deployment/scaling of apps on containerized environment (i.e. Kubernetes, AKS) Experience with real-time and streaming technology (e.g. Azure Event Hubs, Azure Functions Kafka, Spark Streaming) Experience performing data analysis and data exploration Strong critical thinking, communication, and problem solving skills and a quick learner Experience with any big data frameworks on Spark (e.g. PySpark) Experience with cloud-based platforms (i.e. Azure, GPC, AWS) Experience working in multi-developer environment, using version control (i.e. Git) Experience with data modeling and system architecture design Experience partnering cross-functionally with other technical teams (i.e. data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes Experience with setting coding standards, performing code reviews, and mentoring junior developers Experience working in an Agile delivery environment Experience with RDBMS and NoSQL Databases and hands-on query tuning/optimization Experience with orchestrating pipelines using tools (e.g. Airflow, Azure Data Factory) Experience with bash shell scripts, UNIX utilities & UNIX Commands Ability to understand complex systems and solve challenging analytical problems Previous healthcare experience and domain knowledge Exposure/understanding DevOps best practice and CICD pipelines (e.g. Jenkins) null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.