San Francisco, CA, 94103, USA
21 hours ago
Data Engineer
Job Description Marketing Decision Science organization is looking for a Data Engineer who can help building data pipelines for Marketing Analytics. All the work is added to the GUS backlog and assigned to the contractor by the scrum lead. The candidate should have experience with the above tools and experience with Web data. Key Responsibilities: * Build metrics from unstructured data - Chat transcripts, AI Agent product logs, Agent interaction texts * Build metrics from structured data - iceberg tables, Snowflake tables, Salesforce Sales Cloud objects. * Design, develop, and maintain data transformation pipelines using DBT to transform raw data into structured, usable datasets for analytics and reporting. * Collaborate with cross-functional teams including data analysts, software engineers, and product managers to translate business requirements into data-driven solutions that provide actionable insights and enhance customer experiences. * Optimize data storage, retrieval, and processing to support high-performance analytics, ensuring the system scales effectively with increasing data volumes. * Ensure data quality and consistency by implementing automated monitoring, alerting, and validation processes. * Automate and streamline data operations to reduce time-to-insight and enhance data reliability. * Define and uphold data engineering best practices, including code quality, version control, and testing standards. * Support and strengthen data security, privacy, and compliance across all data engineering initiatives to meet industry standards. * Must Have - experience with AWS, dbt, worked with Marketing or Sales data. * Preferred - Work experience with unstructured data and Salesforce objects * Tableau exposure Tools * AWS utilities for data Ingestion * dbt for Data Transformation * Airflow for Pipeline orchestration * Custom Data quality framework * Snowflake for storage and Compute * Salesforce Data Cloud as Zero Copy source * Salesforce Sales Cloud as a Source We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .     To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Skills and Requirements 5-6 years of experience with data engineering experience  Tools modern data stack (Snowflake, AWS, dbt, Airflow, Jupiter notebooks)  Experience with web data, end-to-end data engineering process, and building out data pipelines for web data null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
Confirm your E-mail: Send Email