oncall-guide-ai / evaluation /metric7_8_precision_MRR.py

Commit History

Enhance evaluation framework with comprehensive metrics and improved query complexity analysis, temp bug fixing about metric 7-8
6577369

YanBoChen commited on

Add adaptive relevance thresholds for query complexity in PrecisionMRRAnalyzer; fix typo in condition mapping for postpartum hemorrhage
7620d26

YanBoChen commited on

Update threshold values in latency evaluator and coverage chart generator; enhance precision and MRR analysis with corrected thresholds and new chart generator for detailed metrics visualization.
5d4792a

YanBoChen commited on

Refactor relevance calculation and update thresholds in latency evaluator; enhance precision and MRR analyzer with angular distance metrics; increase timeout for primary generation in fallback configuration.
b0f56ec

YanBoChen commited on

Before Run the 1st Evalation: Add Precision & MRR Chart Generator and a sample test query
a2aaea2

YanBoChen commited on