numeraire.core.protocols.Evaluator#

class numeraire.core.protocols.Evaluator(*args, **kwargs)[source]#

Bases: Protocol

Scores OOS output, emitting rows of the standard tidy result schema.

__init__(*args, **kwargs)#

Methods

__init__(*args, **kwargs)

evaluate(oos_output)

Return rows in the standard result schema (see numeraire.core.schema).

Attributes

requires

Capabilities an OOS output must expose for this evaluator to run.

requires: ClassVar[set[str]]#

Capabilities an OOS output must expose for this evaluator to run.

evaluate(oos_output: object) DataFrame[source]#

Return rows in the standard result schema (see numeraire.core.schema).