Locations: Boston | Atlanta

Who We Are

BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We count on your authenticity, exceptional work, and strong integrity. In return we are committed to supporting you in discovering the most fulfilling career journey possible-and unlocking your potential to advance the world. Our team called Global Services (GS) provides corporate support to business areas such as Finance, Legal, HR, Marketing and IT. This diverse team of experts, operators and specialists represent all levels from Partner to entry level staff, operating across the globe in multiple countries. Global Services is in short, the backbone of BCG.

What You'll Do

As a Global IT GenAI Software Engineer Director & Chapter Lead, you will be at the forefront of BCG's AI-driven transformation journey. BCG is committed to leveraging AI to enhance business operations and client solutions, and your role will be crucial in this mission. You will lead the design, development, testing, and deployment of a self-service chatbot utilizing state-of-the-art technologies such as AWS Bedrock, industry-foundational language models, and LangChain. This chatbot will revolutionize IT support by providing efficient, AI-driven solutions. 

 

You will apply your domain expertise in building and deploying conversational chatbots specifically for IT customer support. This includes ensuring the chatbot integrates seamlessly with IT Service Management tools preferably ServiceNow. Your knowledge of Service Desk processes will be essential in optimizing the chatbot to handle various IT support scenarios effectively. 

 

As a Chapter Lead, you will also be responsible for defining standards and guardrails for how your chapter members execute their work and develop their expertise. As a player-coach, you will line-manage chapter members, guiding their development and ensuring compliance with technology standards, practices, and guardrails. This role combines hands-on contribution with team leadership, supporting both project delivery and the professional growth of your team. 

 

In addition, you will be involved in testing, evaluating, and fine-tuning AI prompts to ensure optimal chatbot performance. You will implement responsible AI practices and establish the necessary guardrails to ensure the chatbot operates ethically, reliably, and effectively. Your responsibilities include overseeing development processes, ensuring high-quality and timely delivery, providing technical leadership and mentorship, and engaging with stakeholders for requirement gathering and project updates. Additionally, you will identify potential risks and develop mitigation strategies to ensure the seamless deployment and operation of the chatbot.

 

 

Among your responsibilities, you will:

Continuously develop Chapter expertise

 

Maintaining best-in-class Chapter expertise and resources in order to deliver the right knowledge and skills to Squads.

Staying abreast of relevant developments and innovations in domain area, both internally and externally.

Maintaining your own technical knowledge through learning and continuous improvement.

Develop Chapter members and the Chapter as a whole

 

Overseeing, providing feedback, and developing Chapter members to help improve domain knowledge and better serve the Squads in which they work.

Discussing Chapter development progress and opportunities with the Tech Area Lead.

Share knowledge and expertise within and outside of the Chapter

 

Ensuring the “how” of the work performed by Chapter members is aligned with established technical roadmaps and guardrails to drive strategy.

Sharing relevant insights and developments within area of expertise with Chapter members and related Chapters.

Actively sharing knowledge and expertise across the organization with other Chapters.

Identify resource needs throughout the organization

 

Engaging Product Owners, Tribe Leads, and Tech Area Leads to allocate Chapter members and ensure Squads have proper technical resourcing and functional expertise.

Identifying expertise and resource gaps and training or hiring the talent needed to
address them.

Work in a Squad to realize its mission

 

Advancing the work of the Squad based on items in the backlog and priorities set by the Product Owner.

Sharing expertise with Squad members and working cross-functionally to advance the work of the Squad.

Enable the organization’s new way of working

 

Modelling behaviors to support the organization’s transformation to a new way of working.

Actively creating and maintaining a positive culture within the Chapter based on Agile leadership behaviors.

What You'll Bring

BA degree in Computer Science, Statistics, or related field with a focus on Artificial Intelligence, Machine Learning, or Natural Language Processing

At least 10 years of working experience, ideally 2+ years of experience developing and experimenting with LLMs and 6+ years of experience developing AI/ML technologies within large and business critical applications

Experience & Skills 

 

Proficiency in Python and all associated DS libraries and frameworks

Strong knowledge in AI, machine learning, and natural language processing

Experience with leveraging, training and fine-tuning Foundation Models, including multimodal inputs and outputs

Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)

Experience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios.

Experience with unstructured.io or similar libraries for handling various document formats and extracting structured information from unstructured data.

Expertise in using LlamaIndex for building and querying knowledge bases, including its data connectors, indexing strategies, and query engines.

Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.

Proficiency in generating and working with text embeddings using models like BERT, GPT, or domain-specific embedding models. Understanding of embedding spaces and their applications in semantic search and information retrieval.

Experience in constructing and querying knowledge graphs, including technologies like Neo4j or RDF triplestores. Understanding of ontology design and graph-based reasoning.

Experience with RAG concepts and fundamentals (vectorDBs, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with generative AI models.

Experience & Skills (Nice to have)

 

Experience with cloud infrastructure for AI/ML

Experience with LLM guardrails

Exeprience with LLM monitoring and observability

Experience with security related to LLM integration

Who You'll Work With

You will be a key member of the IT & Business Platforms (ITBP) team, leading the development of BCG's flagship GenAI use case for an IT support chatbot. This chatbot will serve as a critical component in transforming IT support through AI-driven solutions. Your team will work closely with the Cloud Platform Engineering (CPE) team, which is responsible for building the shared GenAI platform. This platform will support multiple GenAI use cases across the company, ensuring scalable and robust AI solutions. The close collaboration between ITBP and CPE will be essential for the successful implementation and integration of the self-service chatbot and other innovative AI solutions, driving BCG's broader AI transformation agenda. 

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.\n
BCG is an E - Verify Employer. Click here for more information on E-Verify.