Position Purpose:

We are on the lookout for an innovative and strategic Manager, Online Experimentation, to spearhead our organization's efforts in optimizing software testing frameworks and elevating the overall quality and effectiveness of our digital testing platforms. Positioned within the heart of our operational excellence, this role involves leading a dedicated team towards the development and execution of a comprehensive testing and personalization strategy that is in harmony with our broader organizational objectives. The chosen candidate will be instrumental in cultivating a culture of continuous improvement and technological advancement, ensuring the standardization of testing methodologies, and driving the adoption of cutting-edge tools and practices to maintain our competitive edge. 

 

The ideal candidate for this role will possess a unique blend of analytical prowess and digital marketing acumen, underscored by a proven track record in managing multifaceted projects that enhance user engagement and satisfaction. Key responsibilities will encompass the initiation and oversight of online personalization initiatives, from concept to fruition, including but not limited to A/B testing, customer journey analytics, and the integration of novel technologies to enrich the digital customer experience. This role demands a visionary leader capable of translating complex data insights into strategic online experiences, fostering a creative and innovative environment, and aligning digital personalization efforts with the company's strategic goals to drive growth and enhance customer loyalty. 

 

Key Responsibilities: 

Leadership and Strategy: Lead the TCoE team in developing and implementing a comprehensive testing strategy that aligns with organizational goals, driving innovation and excellence in testing practices​​​​. 

Metrics and Measurement: Develop, implement, and evolve metrics and measurements to assess the quality of products under test and the effectiveness of the testing team, ensuring continuous improvement​​. 

Process Standardization: Champion the standardization of testing processes, tools, and methodologies to increase efficiency, reduce redundancy, and ensure consistency across all testing activities​​​​. 

Innovation and Improvement: Continuously research and adopt the latest trends, technologies, and tools in software testing to keep the organization at the cutting edge of testing practices, fostering an environment of innovation​​. 

Team Development: Manage and grow the TCoE's human and technical resources, including recruiting, mentoring, and retaining skilled testing personnel, and ensuring their professional development and engagement​​. 

Collaboration and Alignment: Ensure that testing goals are aligned with project and organizational objectives, facilitating collaboration between business and testing teams and establishing a governance model for testing activities​​. 

Agile and DevOps Integration: Integrate TCoE activities with Agile and DevOps practices, supporting cross-functional teams while maintaining appropriate alignment and governance through the TCoE structure​​. 

Importance of the Role: 

Cross-Functional Leadership: Serve as a pivotal bridge among technical, marketing, and data analytics teams to deliver cohesive and effective online experiences. 

Business Impact: Drive customer engagement and conversion rates through targeted online personalization strategies, significantly contributing to revenue growth. 

Innovation Driver: Lead the exploration of new strategies and technologies to maintain competitiveness in a dynamic digital landscape. 

 

Educational Background: 

Bachelor's Degree in Marketing, Business, Computer Science, Data Science, Statistics, or related field. Master's degree or MBA preferred. 

Relevant certifications in digital marketing, data analytics, UX/UI design are beneficial. 

 

Technical Skills: 

Proficiency in data analysis, statistics, and experience with analytical tools (Google Analytics, Adobe Analytics). 

Hands-on experience with A/B testing and multivariate testing tools (e.g., Optimizely, VWO, Adobe Target). 

Familiarity with programming languages (HTML, CSS, JavaScript, SQL) and data management practices. 

 

Professional Experience: 

Demonstrable experience in digital marketing/personalization and leadership in experimentation projects. 

Experience in cross-functional collaboration and strategic planning. 

Proven ability in innovation and problem-solving within the personalization space. 

 

Personal Attributes: 

Analytical mindset with the ability to translate complex data into actionable strategies. 

Innovative thinking with a propensity for creative problem-solving. 

Strong communication skills and leadership qualities. 

Adaptability to changing technologies and market trends. 

 

Other Requirements: 

Up-to-date with the latest trends in online personalization and digital marketing. 

Ability to network with industry professionals and engage in continuous learning. 

Key Responsibilities:

20% - Business Collaboration - Collaborate with stakeholders, business partners, colleagues, developers and business analysts to deliver high quality analytics solutions; Ensure all business requirements are met and the team has everything needed to perform their analysis.20% - Communicating Results - Provide requested insights to executive leadership as well as peer teams; Present predictive and prescriptive insights to requestors to guide decision-making.10% - Framing & Executing Analytics - Serve as data strategy consultants for the executive leadership team and provide answers to strategic questions; Develop KPI Frameworks for internal organizations to measure performance.40% - People Management & Team Leadership - Provide leadership, mentorship and coaching to team members (individual contributors) and evaluate performance, execution, and contribution. Attract, retain and develop top talent to build an effective and high performing team. Support team in development of business knowledge and technical skills with clear plans and regular assessment of progress. Ensure appropriate processes and job-specific requirements are properly documented. Develop onboarding and training plan for both technical and soft skills that will ensure high level of capabilities within the team. Manage resources effectively to align with strategic initiatives and business needs. Foster collaboration with team members to develop a supportive and engaged team. Support team in the design and development of algorithms and models to use against large datasets to create business insights. Drive team's results and celebrate accomplishments.10% - Project Management & Team Support - Management of business requests, roadmaps, and coordination across other teams to provide insights; Advise all stakeholders on the level of effort involved in producing certain insights and establishing a new request.

Direct Manager/Direct Reports:

This position reports to the Senior Manager or AboveThis position has 1+ direct reports

Travel Requirements:

Typically requires overnight travel 5% to 20% of the time.

Physical Requirements:

Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions, there may be a need to move or lift light articles.

Working Conditions:

Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable.

Minimum Qualifications:

Must be 18 years of age or older.Must be legally permitted to work in the United States.Experience managing and growing team members in a professional settingDemonstrated proficiency in guiding more junior team members through data analysis and visualization fundamentalsExpertise utilizing data analysis to identify key insights that help solve business problems

Preferred Qualifications:

Master's degree in a quantitative field (Analytics, Finance, Data Science, Applied Statistics, Computer Science etc.)  or relevant work experience 

Previous people management experience 

Experience in Marketing/media analytics and experience running marketing experiments. 

Experience with experimentation and web analytics tools like Adobe Analytics, Adobe Target etc. 

Expertise in experimental design and causal inference. 

Adept at partnering with organizations to build KPI frameworks. 

Experience producing deep, statistical analysis in support of testing. 

Proficient in analytics tools such as Python, R, SQL 

Proficient with data visualization software (preferably Tableau) 

Adept in managing business requests and roadmaps for cross functional organizations. 

Minimum Education:

The knowledge, skills and abilities typically acquired through the completion of a bachelor's degree program or equivalent degree in a field of study related to the job.

Preferred Education:

The knowledge, skills and abilities typically acquired through the completion of a master's degree program or equivalent degree in a field of study related to the job.

Minimum Years of Work Experience:

5

Preferred Years of Work Experience:

6

Minimum Leadership Experience:

No previous leadership experience

Preferred Leadership Experience:

1+ year of previous leadership experience

Certifications:

None

Competencies:

Decision QualityCollaboratesDrives EngagementEnsures AccountabilityPlans and AlignsCommunicates EffectivelyCustomer FocusDevelops TalentDrives ResultsManages Conflict