We are looking for an experienced Engineer to join our AI data gathering team and work on supporting cutting-edge generative AI projects.

As a Software Engineer on our team, you will be responsible for designing, developing, and maintaining the systems that enable our systems to understand and interact with content. This position requires creativity, passion, and experience with building innovative solutions to complex technical problems.



Key job responsibilities
• Design and develop scalable content acquisition and data extraction systems to acquire data.
• Build automation data pipelines and insights using big data frameworks (e.g., Spark) to acquire petabytes of data and visualize important KPI's to enable technical direction.
• Optimize our data architecture for performance, scale, resilience and cost efficiency.
• Implement robust systems to process content and extract meaning.
• Develop data pipelines and infrastructure to support petabyte-scale datasets.
• Work closely with scientists and other engineers to rapidly prototype and deploy new algorithms.
• Write high quality, well-tested production code in languages like Python, spark, Java, Scala.