Job Seekers, Please send resumes to resumes@hireitpeople.com Summary:
Our client - a major media and entertainment firm located in NYC - has an immediate need for a Data Engineer.Position Description:
The Data Engineer will be responsible for partnering with Revenue Analytics to onboard and optimize datasets which will be used in the Looker digital analytics platform. To be successful in the role you'll need to be intellectually curious, detail-oriented, open to new ideas, and possess a strong aptitude for quantitative methods. The role requires a strong statistical background, familiarity with modern data warehouses, experience with SQL-like tools, and knowledge of scripting languages (e.g., Python). Experience with predictive modeling or machine learning a plus.Job Duties:Create solutions to transform data from various sources and load it into platforms such as Hadoop to create a data lakeCreate and maintain transformations to summarize/aggregate data and load these so users can consume this data using various BI/Analytics tools.Develop and maintain standards for administration and operation including the scheduling, running, monitoring, logging, management of errors, recovery from failures, and validation of outputs.Contribute to the project planning process by estimating tasks and deliverables.Work closely with Revenue Analytics team members to understand user requirements.Be at the cutting edge of utilizing data about consumers in the media industry to improve audience experience.Help out with complex analytical tasks.Required Skills:4+ years solid experience as a database developer in OLAP environment.BS in computer science, math, physics or equivalent education/training/experience.Experience with ETL's & Data pipelinesExperience performing QC & cleaning up dirty dataExperience with a "big data” platform such as Hadoop, NoSQL DB's or cloud based tools such as Amazon Redshift.Experience with Hive and HiveQLExperienced and comfortable with Unix/Linux operating systemsExpert knowledge in SQL, Python and shell scriptingAbility to work independently and take on projectsAdditional skills desired:Knowledge of SparkQL and/or Postgress SQL would be idealPrior understanding and/or experience within a media and entertainment business, ad tech and related data.Experience with media, Web analytics and consumer data systems is highly desired.Key aspects of the position:Experience with ETLs and data pipelinesExperience with SQL-like big data query languages, HIVE in particularExperience in PythonExperience working in UNIX.