autointent.metrics.ScoringMetricFnWithOOS#

class autointent.metrics.ScoringMetricFnWithOOS#

Bases: Protocol

Protocol for scoring metrics that accept OOS-bearing labels.

Returned by ignore_oos: the decorator filters out None entries from labels (and their paired score rows) before delegating to the underlying ScoringMetricFn.

__call__(labels, scores)#

Calculate scoring metric, dropping OOS-flagged samples first.

Parameters:

  • labels (autointent.custom_types.ListOfGenericLabels)

  • scores (autointent.metrics.custom_types.SCORES_VALUE_TYPE)

Return type:

float