DOCUMENT GENERATION BENCHMARK - DETAILED ANALYSIS REPORT
============================================================

Generated on: 2025-09-17 14:28:34

BASIC STATISTICS
------------------------------
Total queries processed: 40
Average user profile accuracy: 0.374
Average intent capture accuracy: 0.515
Average citation accuracy: 0.101
Average document quality score: 4.435
Overall average score: 1.121

ADVANCED METRICS
------------------------------
Score Statistics:
  user_profile_accuracy:
    Mean: 0.374 ± 0.146
    Median: 0.356
    Range: 0.143 - 0.603

  intent_capture_accuracy:
    Mean: 0.515 ± 0.186
    Median: 0.500
    Range: 0.200 - 1.000

  citation_accuracy:
    Mean: 0.101 ± 0.160
    Median: 0.000
    Range: 0.000 - 0.500

  document_quality_score:
    Mean: 4.435 ± 0.357
    Median: 4.400
    Range: 3.500 - 5.000

Correlations:
  profile_intent_correlation: -0.207
  intent_quality_correlation: -0.271
  citation_quality_correlation: 0.122
  profile_quality_correlation: 0.059

PERFORMANCE BY DOCUMENT TYPE
------------------------------
status_report: 1.145 (n=17)
email: 1.087 (n=16)
faq: 1.143 (n=7)

PERFORMANCE BY USER ROLE
------------------------------
Business Analyst: 1.152 (n=8)
Operations Manager: 1.016 (n=2)
Project Manager: 1.108 (n=18)
IT Systems Lead: 1.175 (n=4)
Risk Analyst: 1.112 (n=4)
Product Manager: 1.125 (n=4)

CITATION ANALYSIS
------------------------------
Documents with citations: 40/40
Average citations per document: 21.20

Most cited messages:
  Msg_1333: 22 citations
  Msg_2965: 17 citations
  Msg_4238: 13 citations
  Msg_3437: 12 citations
  Msg_3804: 12 citations

QUALITY DIMENSIONS ANALYSIS
------------------------------
citation_quality: 4.175 ± 0.441
