Skip to content

Tasks Overview

STEB evaluates style text embeddings across six task types. Each task probes a different aspect of how well embeddings capture stylistic properties.

Task What It Measures Primary Metric
Clustering Style-based cluster formation V-measure
All-to-All Pair Classification Same-vs-different style discrimination EER, AUC
Pre-defined Pair Classification Verification on pre-defined pairs EER, AUC
Order Alignment Preservation of graded style ordering Accuracy
Retrieval Style-matched text retrieval MRR, Recall@K
Probing Linguistic property encoding Accuracy