“As AI is used more widely, new opportunities for exploiting weak spots in the technology also are emerging. That’s given rise to companies that probe AI systems for vulnerabilities, with the goal of catching malicious input before it can wreak havoc.”
https://www.wired.com/story/company-uses-ai-outwit-malicious-ai/