📊 Prediction Frequency Distribution Analysis

Compare the prediction probability distributions between the original model and the best distilled model. This analysis helps understand how knowledge distillation affects the confidence and calibration of predictions.

{% if chart_data and chart_data.frequency_distribution_data and chart_data.frequency_distribution_data.has_data %}

Prediction Probability Distribution

Cumulative Distribution Function

Distribution Statistics

🔵 Original Model

Model Type: {{ chart_data.frequency_distribution_data.original.model_type }}

Accuracy: {{ "%.3f" | format(chart_data.frequency_distribution_data.original.accuracy) }}

Mean Probability: {{ "%.3f" | format(chart_data.frequency_distribution_data.original.mean) }}

Std Deviation: {{ "%.3f" | format(chart_data.frequency_distribution_data.original.std) }}

🔴 Best Distilled Model

Model Type: {{ chart_data.frequency_distribution_data.best.model_type }}

Accuracy: {{ "%.3f" | format(chart_data.frequency_distribution_data.best.accuracy) }}

Mean Probability: {{ "%.3f" | format(chart_data.frequency_distribution_data.best.mean) }}

Std Deviation: {{ "%.3f" | format(chart_data.frequency_distribution_data.best.std) }}

{% if chart_data.frequency_distribution_data.ks_statistic %}

📈 Comparison Metrics

KS Statistic: {{ "%.3f" | format(chart_data.frequency_distribution_data.ks_statistic) }}

Mean Difference: {{ "%.3f" | format(chart_data.frequency_distribution_data.best.mean - chart_data.frequency_distribution_data.original.mean) }}

Accuracy Change: {{ "%+.3f" | format(chart_data.frequency_distribution_data.best.accuracy - chart_data.frequency_distribution_data.original.accuracy) }}

{% endif %}

{% else %}

No frequency distribution data available. Ensure that both original and distilled models have been evaluated.

{% endif %}