EvaluationResponse

​

overview

the EvaluationResponse class represents the results of evaluating a test call. it contains a list of evaluation results and any additional data from the evaluation process.

​

constructor

EvaluationResponse(
    evaluation_results: List[EvaluationResult],
    extra_data: Dict[str, Any]
)

​

parameters

• evaluation_results (List[EvaluationResult]): list of individual evaluation results
• extra_data (Dict[str, Any]): additional data from the evaluation process, such as fixa-observe urls

​

example usage

response = EvaluationResponse(
    evaluation_results=[
        EvaluationResult(
            name="order_success",
            passed=True,
            reason="the order was successfully placed and confirmed"
        ),
        EvaluationResult(
            name="price_confirmed",
            passed=False,
            reason="the price was not mentioned during the conversation"
        )
    ],
    extra_data={
        "fixa_observe_call_url": "https://www.fixa.dev/observe/calls/123"
    }
)

​

notes

• returned by both LocalEvaluator and CloudEvaluator
• evaluation_results contains the pass/fail status and reasoning for each evaluation criterion
• extra_data may contain different information depending on the evaluator used
• with cloudevaluator, extra_data includes the fixa-observe url for detailed analysis