oncall-guide-ai / evaluation /latency_evaluator.py

Commit History

Update query file references for full evaluation and improve user prompts in evaluation scripts (before optimized_general_pipeline)
5fb5e09

YanBoChen commited on

Update query file references for full evaluation and correct typo in pre_user_query_evaluate.txt for pre-test.
e84171b

YanBoChen commited on

Update threshold values in latency evaluator and coverage chart generator; enhance precision and MRR analysis with corrected thresholds and new chart generator for detailed metrics visualization.
5d4792a

YanBoChen commited on

Refactor relevance calculation and update thresholds in latency evaluator; enhance precision and MRR analyzer with angular distance metrics; increase timeout for primary generation in fallback configuration.
b0f56ec

YanBoChen commited on

Before Run the 1st Evalation: Add Precision & MRR Chart Generator and a sample test query
a2aaea2

YanBoChen commited on

Add extraction and relevance evaluators for condition extraction and retrieval relevance analysis
88e76fd

YanBoChen commited on

Add latency and relevance evaluators for medical query analysis (evaluatoin)
3e2ffcb

YanBoChen commited on