DOCUMENT GENERATION BENCHMARK - DETAILED ANALYSIS REPORT
============================================================

Generated on: 2025-09-17 13:45:39

BASIC STATISTICS
------------------------------
Total queries processed: 40
Average user profile accuracy: 0.427
Average intent capture accuracy: 0.470
Average citation accuracy: 0.139
Average document quality score: 4.287
Overall average score: 1.104

ADVANCED METRICS
------------------------------
Score Statistics:
  user_profile_accuracy:
    Mean: 0.427 ± 0.160
    Median: 0.410
    Range: 0.163 - 0.787

  intent_capture_accuracy:
    Mean: 0.470 ± 0.210
    Median: 0.400
    Range: 0.200 - 1.000

  citation_accuracy:
    Mean: 0.139 ± 0.226
    Median: 0.000
    Range: 0.000 - 1.000

  document_quality_score:
    Mean: 4.286 ± 0.306
    Median: 4.330
    Range: 4.000 - 5.000

Correlations:
  profile_intent_correlation: -0.014
  intent_quality_correlation: -0.174
  citation_quality_correlation: -0.300
  profile_quality_correlation: -0.173

PERFORMANCE BY DOCUMENT TYPE
------------------------------
email: 1.105 (n=17)
status_report: 1.103 (n=15)
faq: 1.103 (n=8)

PERFORMANCE BY USER ROLE
------------------------------
Project Manager: 1.120 (n=31)
Business Analyst: 1.080 (n=4)
IT Systems Lead: 1.028 (n=4)
Nurse Informaticist: 1.007 (n=1)

CITATION ANALYSIS
------------------------------
Documents with citations: 40/40
Average citations per document: 49.12

Most cited messages:
  Msg_3433: 31 citations
  Msg_3590: 25 citations
  Msg_3989: 25 citations
  Msg_2503: 20 citations
  Msg_1545: 20 citations

QUALITY DIMENSIONS ANALYSIS
------------------------------
citation_quality: 4.125 ± 0.331
