seismometer.data.performance.calculate_eval_ci

seismometer.data.performance.calculate_eval_ci(stats, truth, output, conf=0.95)

Calculate confidence intervals for ROC, PR, and other performance metrics from a stats frame.

Parameters:

• stats (pd.DataFrame) – The performance statistics, generated by calculate_bin_stats or similar.

• truth (pd.Series) – The series of data with the ground truth labeling that is associated with the stats frame.

• output (pd.Series) – The series of model output associated with the stats frame.

• conf (Number, optional) – The confidence level for calculation, by default 0.95.

Returns:

A dictionary of confidence details for an evaluation plot.

Return type:

dict