seismometer.data.performance.calculate_eval_ci

seismometer.data.performance.calculate_eval_ci(stats, truth, output, conf=0.95, force_percentages=False)

Calculate confidence intervals for ROC, PR, and other performance metrics from a stats frame.

Parameters:

  • stats (pd.DataFrame) – The performance statistics, generated by calculate_bin_stats or similar.

  • truth (pd.Series) – The series of data with the ground truth labeling that is associated with the stats frame.

  • output (pd.Series) – The series of model output associated with the stats frame.

  • conf (Number, optional) – The confidence level for calculation, by default 0.95.

  • force_percentages (bool, optional) – Flag to indicate that outputs should be converted to percentages (0-100), by default False.

Returns:

A dictionary of confidence details for an evaluation plot.

Return type:

dict