Aiming to support developers (and assessors) in generating evidence that shows the trustworthiness of their AI applications, the AIoD platform will provide interfaces and tools for testing AI applications.
The first release of the AIoD platform offers a demo of the AI testing framework which is currently being developed by the AIoD partners. The AI testing framework:
- shows how to design and execute AI tests using the AIoD platform
- separates the AI application under test from the tool that computes the metric (test tool or benchmarking tool) via a well defined interface
- simplifies benchmarking of different AI applications against each other
- is extensible for integration of further specific test tools
All in all, the AI testing framework paves the way for implementing systematic, comparable and reproducible testing in a easy-to-use and extensible manner.