autointent.metrics.ScoringMetricFn#

class autointent.metrics.ScoringMetricFn#

Bases: Protocol

Protocol for scoring metrics.

__call__(labels, scores)#

Calculate scoring metric.

Parameters:

  • labels (autointent.metrics.custom_types.LABELS_VALUE_TYPE) – ground truth labels for each utterance - multiclass case: list representing an array of shape (n_samples,) with integer values - multilabel case: list representing a matrix of shape (n_samples, n_classes) with integer values

  • scores (autointent.metrics.custom_types.SCORES_VALUE_TYPE) – for each utterance, this list contains scores for each of n_classes classes

Returns:

Score of the scoring metric

Return type:

float