H2O.ai and AI Verify Foundation Collaborate to Power Responsible Adoption of AI at Scale

SINGAPORE and MOUNTAIN VIEW, Calif., Oct. 10, 2024 — H2O.ai, an open-source leader in generative AI and machine learning, has announced a collaboration with AI Verify to ensure the safe deployment of AI. As a part of the collaboration, H2O has launched an initiative alongside the foundation to provide clients the ability to test and govern their AI systems using H2O’s platform and further the global open-source community.

As a part of the collaboration, H2O has agreed to contribute benchmarks and code to AI Verify’s open-source Project Moonshot toolkit for Large Language Modeling (LLM) application testing and provide support for tests recommended by AI Verify on its Machine Learning (ML) and LLM Ops platform.

H2O.ai believes that responsible AI starts with ensuring transparency, accountability, and governance throughout the lifecycle of AI systems, from development to deployment. The H2O team has developed robust tools like H2O EvalStudio for customers to systematically assess the performance, security, fairness, and overall effectiveness of LLMs and Retrieval-Augmented Generation systems. H2O’s collaboration with AI Verify Foundation will further strengthen such efforts, ensuring organizations can meet both internal governance standards and external regulatory requirements.

“H2O has been committed to the open-source community since our founding and we believe every organization should have a strategy to safely test AI,” said Sri Ambati, CEO and co-founder of H2O.ai. “Working with AI Verify clearly aligns with our values and we look forward to continue leading the charge for responsible AI adoption.”

“We believe that appropriate tools and approaches to AI testing is critical to enable adoption of AI for society, business and citizens,” said Shameek Kundu, executive director at the AI Verify Foundation. “We are very pleased to have H2O, an active member of the foundation, as a partner in this journey.”

H2O’s contribution to AI Verify’s Project Moonshot provides one of the world’s first LLM Evaluation Toolkits, designed to integrate benchmarking, red teaming, and testing baselines. The toolkit helps developers, compliance teams, and AI system owners manage LLM deployment risks by providing a seamless way to evaluate their applications’ performance, both pre- and post-deployment.

About H2O.ai

Founded in 2012, H2O.ai is at the forefront of the AI movement to democratize Generative AI. H2O.ai’s open-source Generative AI and Enterprise h2oGPT, combined with Document AI and the award-winning autoML Driverless AI, have transformed more than 20,000 global organizations and over half of the Fortune 500 and household brands, including AT&T, Commonwealth Bank of Australia, Chipotle, ADP, Workday, Progressive Insurance, and AES. H2O.ai’s AI for Good program supports nonprofit groups, foundations, and communities in their efforts to advance education, healthcare, and environmental conservation, including identifying areas vulnerable to natural disasters and protecting endangered species.

Source: H2O.ai