**Your job** The AI at Indeed team empowers Indeedians to wield AI to help people get jobs. We partner with Indeed teams to create and implement AI tools that save time, boost revenue, and enhance satisfaction. This role will involve building intelligent agents integrated with Salesforce’s Agentforce, utilizing innovative techniques like ReAct (Reasoning and Acting), Reflection, and rigorous model evaluation methods to ensure accuracy and reliability. You’ll be a strategic technical leader, partnering across teams to deploy scalable AI solutions that enhance our products and give technical mentorship to other engineers. **Who you are** + Design and develop software systems with existing large language models to support complex tasks, using advanced techniques such as prompt engineering, in-context learning, reinforcement learning, and LoRA. + Apply ReAct (Reasoning and Acting) frameworks to create AI agents that handle complex decision-making processes and interact with users. + Partner with Salesforce’s Agentforce and Indeed’s LLM platform team to develop custom agents that address complex user needs and deliver personalized support, utilizing Indeed's in-house agent architecture. + Use existing retrieval-augmented generation (RAG) pipelines for knowledge retrieval, enhancing response accuracy through the use of vector databases and custom embedding strategies. + Leverage established vector databases (e.g., Pinecone, FAISS, Weaviate) for high-speed embedding storage and querying, ensuring fast, relevant responses + Adopt and extend existing model evaluation frameworks to assess accuracy, response relevance, fairness, and consistency, with metrics for real-time and offline evaluation + Mentor team members in LLM deployment, evaluation best practices, and MLOps, fostering a culture of quality, innovation, and accountability. **Who we are** + Bachelor’s Degree in Computer Science or related technical discipline. + 7+ years in software engineering, with 3+ years in AI/ML or NLP. Demonstrated experience in production deployment of large language models or similar ML systems. + Extensive experience with frameworks like Hugging Face Transformers, OpenAI API, and familiarity with large language models such as GPT, BERT, and T5. + In-depth knowledge of model evaluation techniques, including accuracy, relevance, and fairness metrics, as well as practical experience implementing both automated and manual evaluation processes. + Familiarity with ReAct frameworks for reasoning-based decision-making and Reflection methods to improve contextual memory and model behavior over extended conversations. + Proficiency with Salesforce ecosystem, particularly with Agentforce, to build tailored, intelligent agents for Indeed’s use cases. + Solid experience with retrieval-augmented generation (RAG), embedding strategies, and vector databases (e.g., Pinecone, FAISS, Weaviate) for scalable vector search solutions. + Exposure to and excitement about AI/ML solutions, including familiarity with TensorFlow, PyTorch, and/or SageMaker; **Our mission** As the world’s number 1 job site*, our mission is to help people get jobs. We strive to cultivate an inclusive and accessible workplace where all people feel comfortable being themselves. We're looking to grow our teams with more people who share our enthusiasm for innovation and creating the best experience for job seekers. (*comScore Total Visits, September 2023) **Salary Range Disclaimer** The base salary range represents the low and high end of the Indeed salary range for this position in the given work location. Actual salaries will vary depending on factors including but not limited to location, experience, and performance. The range(s) listed is just one component of Indeed's total compensation package for employees. Other rewards may include quarterly bonuses, Restricted Stock Units (RSUs), a Paid Time Off policy, and many region-specific benefits. **Salary Range Transparency** Austin, Metro Area 167,000- 243,000 USD per year New York City, Metro Area 206,000 - 298,000 USD per year Seattle, Metro Area 217,000 - 315,000 USD per year San Francisco, Bay Area 224,000 - 324,000 USD per year Remote, US 167,000- 243,000 USD per year **EEO and Accommodations** Indeed is deeply committed to building a workplace and global community where inclusion is not only valued, but prioritized. We’re proud to be an Equal Employment and Affirmative Action employer seeking to create a welcoming and diverse environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity or expression, family status, marital status, sexual orientation, religious creed, national origin, genetics, neuro-diversity, disability, age, status as a protected veteran, or any other non-merit based or legally protected grounds. Indeed is dedicated to providing reasonable accommodations to qualified individuals with known disabilities to participate in the employment application process. To request an accommodation, an applicant should contact Talent Attraction Accommodations at 1-855-567-7767, or by email at accommodations@indeed.com. In the request for an accommodation, please inform us of the nature of your request and your contact information. If you are requesting accommodation for an interview, please reach out at least one week in advance of your interview. **Inclusion & Belonging** Inclusion and belonging are fundamental to our hiring practices and company culture, forming an integral part of our vision for a better world of work. At Indeed, we’re committed to the wellbeing of our employees and on a mission to make this the best place to work and thrive. We believe that fostering a diverse and inclusive environment where every employee feels respected and accepted benefits everyone, fueling innovation and creativity. We value diverse experiences, including those who have had prior contact with the criminal legal system. We are committed to providing individuals with criminal records, including formerly incarcerated individuals, a fair chance at employment. Those with military experience are encouraged to apply. Equivalent expertise demonstrated through a combination of work experience, training, military experience, or education is welcome. **Privacy Policy** Like other employers Indeed uses our own technologies to help us find and attract top talent from around the world. In addition to our site’s user and privacy policy found at https://www.indeed.com/legal, we also want to make you aware of our recruitment specific privacy policy found at https://www.indeed.com/legal/indeed-jobs. The deadline to apply to this position is February 7th, 2025. Job postings may be extended at the hiring team’s discretion based on applicant volume. **Req ID: 44860** Apply now (https://careers-indeed.icims.com/jobs/44860/software-engineer-iv%2c-ai-for-indeed/job?mode=apply&apply=yes&in\_iframe=1&hashed=-1834446294) **ID** _2024-44860_ **Job Locations** _US-Remote_