Data Engineer
Genius
MediaLab is a media & technology company focused on acquiring and growing properties and global brands. The organization is a unique combination of private equity, holding company and operating entity. We continue to expand and are proud of the prominent market position of our brands.
Come join an exceptionally talented team of engineers, designers, product and business builders. HQ is located in sunny Santa Monica, California with growing teams in New York, and across cities in the US and Latin America.
Your Role at MediaLab
MediaLab Engineering supports a growing number of applications across multiple business verticals which have been acquired through a careful selection process to integrate with its internal Ad platform that processes billions of impressions a month. The technical effort involved is massive and we need go-getters looking to make a substantial impact.
As a Data Engineer, you will be a key member of the team that builds and maintains data platform solutions at MediaLab. The Data team works with all of the MediaLab brands (Genius, Imgur, Kik, Worldstar Hip-Hop, Amino, Whisper) as well as business teams across the organization. We own a streaming pipeline which handles thousands of events per second and billions per day; a BigQuery instance comprising dozens of schemas, thousands of tables, and over a petabyte of storage; and hundreds of DAGs in Airflow and Dataform. We work in python, SQL and golang and strive to write clean, efficient and reusable code, making use of common tooling to ensure code is well-formed and that tests pass before deployment. What You'll DoMaintain and optimize go-based pub/sub consumers handling complex transformation logicImprove the efficiency of multiple repositories dedicated to ingesting and parsing data from a wide variety of sourcesHelp improve our monitoring efforts and troubleshoot problems with ETL jobs and event pipelines as they ariseSupport requests from business teams to find and ingest sources of data that we currently lackWork with the engineering teams on all of our brands to integrate their application data to the data warehouse/data lakeContribute to setting up and adjusting deployment workflowsWhat We're Searching For1-2 years of professional experience as a data engineer, or software engineer with significant exposure to working with dataMust be comfortable with python. Golang experience is a big plus.Must have experience with at least one major cloud provider (GCP and/or AWS preferred)Must have experience using containers; kubernetes experience is preferredVery solid SQL skills; must understand how to make complex queries run efficientlyMust be able to write clear documentationExperience with some CI/CD platformExperience with terraform or infra as codeExperience with at least one major data warehouse (BigQuery, Redshift, Snowflake, etc) is a big plusExperience working with at least one pub/sub tool (kafka, kinesis, google pub/sub, rabbitmq, etc) is a plusExperience in the ad tech or digital publishing industries is a nice-to-haveAt MediaLab, we rely on a range of backgrounds, experiences, and ideas. We value diversity, and we’re proud to be an inclusive, equal opportunity workplace.
Come join an exceptionally talented team of engineers, designers, product and business builders. HQ is located in sunny Santa Monica, California with growing teams in New York, and across cities in the US and Latin America.
Your Role at MediaLab
MediaLab Engineering supports a growing number of applications across multiple business verticals which have been acquired through a careful selection process to integrate with its internal Ad platform that processes billions of impressions a month. The technical effort involved is massive and we need go-getters looking to make a substantial impact.
As a Data Engineer, you will be a key member of the team that builds and maintains data platform solutions at MediaLab. The Data team works with all of the MediaLab brands (Genius, Imgur, Kik, Worldstar Hip-Hop, Amino, Whisper) as well as business teams across the organization. We own a streaming pipeline which handles thousands of events per second and billions per day; a BigQuery instance comprising dozens of schemas, thousands of tables, and over a petabyte of storage; and hundreds of DAGs in Airflow and Dataform. We work in python, SQL and golang and strive to write clean, efficient and reusable code, making use of common tooling to ensure code is well-formed and that tests pass before deployment. What You'll DoMaintain and optimize go-based pub/sub consumers handling complex transformation logicImprove the efficiency of multiple repositories dedicated to ingesting and parsing data from a wide variety of sourcesHelp improve our monitoring efforts and troubleshoot problems with ETL jobs and event pipelines as they ariseSupport requests from business teams to find and ingest sources of data that we currently lackWork with the engineering teams on all of our brands to integrate their application data to the data warehouse/data lakeContribute to setting up and adjusting deployment workflowsWhat We're Searching For1-2 years of professional experience as a data engineer, or software engineer with significant exposure to working with dataMust be comfortable with python. Golang experience is a big plus.Must have experience with at least one major cloud provider (GCP and/or AWS preferred)Must have experience using containers; kubernetes experience is preferredVery solid SQL skills; must understand how to make complex queries run efficientlyMust be able to write clear documentationExperience with some CI/CD platformExperience with terraform or infra as codeExperience with at least one major data warehouse (BigQuery, Redshift, Snowflake, etc) is a big plusExperience working with at least one pub/sub tool (kafka, kinesis, google pub/sub, rabbitmq, etc) is a plusExperience in the ad tech or digital publishing industries is a nice-to-haveAt MediaLab, we rely on a range of backgrounds, experiences, and ideas. We value diversity, and we’re proud to be an inclusive, equal opportunity workplace.
Confirm your E-mail: Send Email
All Jobs from Genius