Prompt Security, a platform for enterprise generative AI security, has launched from stealth and announced $5 million in Seed funding. The round was led by Hetz Ventures with participation from Four Rivers and angels including CISOs at Airbnb, Elastic, and Dolby.
Research from Google has shown that LLMs like ChatGPT can be manipulated into revealing large amounts of data on which they were trained. The recent lawsuit against OpenAI filed by The New York Times alleging that ChatGPT can output almost-verbatim article excerpts in its responses highlights the potential for generative AI tools to leak training data.
Prompt Security helps enterprises benefit from the adoption of generative AI while also protecting from a range of risks to the applications, employees, and customers. It inspects each prompt and model response to prevent the exposure of sensitive data, block harmful content, and secure against a range of gen AI-specific attacks. The solution also provides the leadership of enterprises with visibility and governance over the AI tools used within their organizations.
“Generative AI is rapidly infiltrating enterprises and this brings a world of new high-stakes risks,” said Itamar Golan, CEO and co-founder of Prompt Security. “Employees have a strong incentive to share enterprise data with gen AI tools, which are often trained on the data and can leak it afterwards. Likewise, when organizations integrate gen AI into their products it opens them up to a host of security challenges, including models being manipulated by bad actors, and content being generated that is unsafe or infringes on copyright. Yet despite all the risks, gen AI unlocks immense value, and adopting it isn’t a matter of choice — it’s key to business survival.”
Prompt Security can be deployed in an organization in minutes and is already helping dozens of companies protect their applications, employees, and customers from new generative AI-associated threats. “Our mission is to enable enterprises to confidently adopt transformative AI technology on a massive scale by securing their generative AI footprint end-to-end,” Golan added.
The company was founded in August 2023 by CEO Golan and Lior Drihem, who serves as CTO. Its platform already supports millions of prompts and thousands of users per month. “After getting to know Itamar and Lior, I can say without a doubt that they uniquely understand both the incredible potential of generative AI as well as the new attack surface that comes with it,” added Pavel Livshiz, General Partner at Hetz Ventures.
