aqua-evaluation
Installation
SKILL.md
AQUA Model Evaluation
Use this skill when the user wants to evaluate LLM models on OCI Data Science using AI Quick Actions.
Supported Metrics
| Metric | Description | Best For |
|---|---|---|
| BERTScore | Embedding-based semantic similarity (precision, recall, F1) | General text quality, aligns well with human judgement |
| ROUGE | N-gram overlap between generated and reference text | Summarization tasks |
| Perplexity | How well the model predicts the text | Language modeling quality |
| Text Readability | Reading level / complexity of generated text | Content accessibility |
Dataset Format
JSONL format with required prompt and completion keys, optional category: