KAIROS Evaluation Software
Description
The KAIROS Evaluation Software Suite was developed by NIST in support of evaluation of DARPA's Program on Knowledge Directed Artificial Intelligence Reasoning Over Schemas (KAIROS). Some of the capabilities of this software include:* calculating a variety of metrics and scores indicative of performance of individual KAIROS systems* processing and format conversion of KAIROS system output, data annotations, and human assessment results* analyzing metrics, scores, and assessment results* generating statistics and charts summarizing these results
Resources
| Name |
Format |
Description |
Link |
Tags
- human-language-technology-hlt
- multimodal-and-multilingual-information-retrieval-ir
- artificial-intelligence-ai-explainability
- evaluation-of-ai-systems