Back to Job SearchThe team you'll be working with:
The AgentForce Tester is responsible for ensuring the quality, reliability, and performance of AI Agents built on the AgentForce platform. This role will play a key part in validating agent behaviour, testing workflows, identifying defects, and ensuring that agents provide accurate, safe, and compliant responses across all supported use cases. The Tester will collaborate closely with developers, product owners, and business stakeholders to enhance overall agent performance and customer satisfaction.
What you'll be doing:
Testing & Quality Assurance
- Design, execute, and document test plans and test cases for AI agents within the AgentForce environment.
- Conduct manual and automated testing across conversational flows, integrations, API calls, and user journeys.
- Validate agent accuracy, intent recognition, response quality, safety, and adherence to business rules.
- Perform regression testing following updates, fine‑tuning, or retraining cycles.
- Test agents across various channels (e.g., web, mobile, CRM interfaces, chat widgets).
Defect Identification & Resolution
- Log defects clearly with reproducible steps and diagnostics.
- Collaborate with engineering teams to troubleshoot issues and validate fixes.
- Identify gaps in requirements, edge cases, and potential failure points.
Data & Performance Analysis
- Analyse conversation logs to detect errors, misclassifications, and optimisation opportunities.
- Monitor agent performance metrics such as accuracy, latency, handoff rates, and user satisfaction.
- Provide feedback and insights to improve training data, prompts, and system configuration.
Compliance & Safety
- Ensure agents meet organisational standards for security, data handling, and responsible AI practices.
- Validate that responses avoid prohibited content and meet safety guardrails.
- Support audits and documentation related to testing coverage and release readiness.
Collaboration & Continuous Improvement
- Work closely with Product, Engineering, and Business SMEs to align testing with functional requirements.
- Contribute to the development of testing frameworks, automation tools, and best practices.
- Participate in sprint ceremonies and cross‑functional working groups.
What experience you'll bring:
- Proven experience in software testing, QA, or conversational AI testing.
- Familiarity with testing methodologies (functional, regression, exploratory, UAT).
- Experience with AI/ML concepts, LLM‑based systems, or chatbot testing (preferred).
- Understanding of JSON, APIs, and test automation frameworks.
- Strong analytical skills with the ability to identify inconsistencies and patterns.
- Excellent communication skills and attention to detail.
- Ability to work in agile environments and manage multiple priorities.
Desired Qualifications
- Experience with Salesforce AgentForce, Einstein, or similar AI agent platforms.
- Knowledge of prompt engineering, training data quality, or NLP.
- Experience working with secure or regulated environments.
Who we are:
We’re a business with a global reach that empowers local teams, and we undertake hugely exciting work that is genuinely changing the world. Our advanced portfolio of consulting, applications, business process, cloud, and infrastructure services will allow you to achieve great things by working with brilliant colleagues, and clients, on exciting projects.
Our inclusive work environment prioritises mutual respect, accountability, and continuous learning for all our people. This approach fosters collaboration, well-being, growth, and agility, leading to a more diverse, innovative, and competitive organisation. We are also proud to share that we have a range of Inclusion Networks such as: the Women’s Business Network, Cultural and Ethnicity Network, LGBTQ+ & Allies Network, Neurodiversity Network and the Parent Network.
For more information on Diversity, Equity and Inclusion please click here: Creating Inclusion Together at NTT DATA UK | NTT DATA
what we'll offer you:
We offer a range of tailored benefits that support your physical, emotional, and financial wellbeing. Our Learning and Development team ensure that there are continuous growth and development opportunities for our people. We also offer the opportunity to have flexible work options.
You can find more information about NTT DATA UK & Ireland here: https://uk.nttdata.com/
We are an equal opportunities employer. We believe in the fair treatment of all our employees and commit to promoting equity and diversity in our employment practices. We are also a proud Disability Confident Committed Employer - we are committed to creating a diverse and inclusive workforce. We actively collaborate with individuals who have disabilities and long-term health conditions which have an effect on their ability to do normal daily activities, ensuring that barriers are eliminated when it comes to employment opportunities. In line with our commitment, we guarantee an interview to applicants who declare to us, during the application process, that they have a disability and meet the minimum requirements for the role. If you require any reasonable adjustments during the recruitment process, please let us know. Join us in building a truly diverse and empowered team.
Location
“Upon joining the NTT DATA UK family, you will experience a culturally diverse organisation living our values of Clients First, Teamwork and Foresight as we partner with our customers every day.
At NTT DATA UK, we are proud to support and invest in our people. We offer a variety of rewarding career paths and opportunities to develop professionally - with access to cutting edge innovation.”
Niccolo Spataro, CEO, NTT DATA UK
