autointent.metrics.scoring_neg_coverage#

autointent.metrics.scoring_neg_coverage(labels, scores)#

Calculate negative coverage for multilabel classification.

Evaluates how far we need to go down the list of labels to cover all proper labels. The ideal value is 1, the worst value is 0.

Parameters:

labels (autointent.metrics.custom_types.LABELS_VALUE_TYPE) – Ground truth labels for each utterance.
scores (autointent.metrics.custom_types.SCORES_VALUE_TYPE) – For each utterance, scores for each of n_classes classes.

Returns:

Negative coverage score.

Return type: