Iteration 1 - OR_EXPERT_REFINEMENT
Sequence: 3
Timestamp: 2025-07-25 22:45:19

Prompt:
You are an Operations Research (OR) expert in iteration 1 of an alternating optimization process. The algorithm alternates between OR expert analysis and data engineering implementation until convergence.

CRITICAL MATHEMATICAL CONSTRAINTS FOR LINEAR/MIXED-INTEGER PROGRAMMING:
- The optimization problem MUST remain Linear Programming (LP) or Mixed-Integer Programming (MIP)
- Objective function MUST be linear: minimize/maximize ∑(coefficient × variable)
- All constraints MUST be linear: ∑(coefficient × variable) ≤/≥/= constant
- Decision variables can be continuous (LP) or mixed continuous/integer (MIP)
- NO variable products, divisions, or other nonlinear relationships
- If previous iteration introduced nonlinear elements, redesign as linear formulation
- Maintain between 2 and 20 constraints for optimization feasibility

YOUR SCOPE: Focus exclusively on optimization modeling and mapping analysis. Do NOT propose database changes.
ROW COUNT AWARENESS: Understand that data engineer applies 3-row minimum rule - insufficient table data gets moved to business_configuration_logic.json.


DATA AVAILABILITY CHECK: 
Before listing missing requirements, verify:
- Check current schema for required data columns
- Check business configuration logic for required parameters  
- Only list as "missing" if data is truly unavailable
- If all mappings are "good", missing_requirements should be []

CONSISTENCY RULES:
- IF all mapping_adequacy == "good" THEN missing_optimization_requirements = []
- IF missing_optimization_requirements = [] THEN complete CAN be true
- IF complete == true THEN confidence should be "high"

SELF-CHECK: Before responding, verify:
1. Does current schema contain the data I claim is missing?
2. Are my mapping assessments consistent with missing requirements?
3. Is my complete status consistent with missing requirements?

MAPPING COMPLETENESS CHECK: Ensure logical consistency between:
- All objective coefficients mapped with adequacy evaluation
- All constraint bounds mapped with adequacy evaluation  
- All decision variables mapped with adequacy evaluation
- Missing requirements list matches inadequate mappings only


CRITICAL: Respond with ONLY a valid JSON object. No explanations, no markdown, no extra text.



CURRENT STATE (iteration 0):
{
  "iteration": 1,
  "converged": false,
  "business_context": "A music festival organizer wants to maximize the total number of weeks that songs featured in the festival have spent on top charts, while ensuring that the festival includes a diverse set of artists and respects budget constraints on the number of songs per artist.",
  "optimization_problem": "The objective is to maximize the total weeks on top charts for songs selected for the festival. Constraints include limiting the number of songs per artist, ensuring a minimum number of artists are represented, and respecting the festival's capacity for the total number of songs.",
  "objective": "maximize \u2211(Weeks_on_Top \u00d7 x_song)",
  "table_count": 1,
  "key_changes": [
    "Schema changes include creating new tables for decision variables and constraint bounds, and updating business configuration logic for scalar parameters and formulas."
  ],
  "math_consistency": "high",
  "next_iteration_focus": "Define and map the missing constraint bounds and decision variables to the schema or business configuration logic.",
  "mapping_adequacy_summary": "needs_improvement"
}

CURRENT SCHEMA:
```sql
-- Iteration 1 Database Schema
-- Objective: Schema changes include creating new tables for decision variables and constraint bounds, and updating business configuration logic for scalar parameters and formulas.

CREATE TABLE song_selection (
  x_song BOOLEAN
);

CREATE TABLE volume (
  Weeks_on_Top INTEGER
);


```

CURRENT DATA DICTIONARY:
{
  "tables": {
    "song_selection": {
      "business_purpose": "Binary decision variable indicating whether a song is selected for the festival",
      "optimization_role": "decision_variables",
      "columns": {
        "x_song": {
          "data_type": "BOOLEAN",
          "business_meaning": "Binary decision variable indicating whether a song is selected for the festival",
          "optimization_purpose": "Decision variable in optimization formulation",
          "sample_values": [
            0,
            1
          ]
        }
      }
    },
    "volume": {
      "business_purpose": "Number of weeks the song has been on top charts",
      "optimization_role": "objective_coefficients",
      "columns": {
        "Weeks_on_Top": {
          "data_type": "INTEGER",
          "business_meaning": "Number of weeks the song has been on top charts",
          "optimization_purpose": "Coefficient in objective function",
          "sample_values": [
            5,
            10,
            15
          ]
        }
      }
    }
  }
}


CURRENT BUSINESS CONFIGURATION LOGIC:
{
  "Total_Song_Capacity": {
    "sample_value": 50,
    "data_type": "INTEGER",
    "business_meaning": "Maximum number of songs the festival can include",
    "optimization_role": "Constraint bound for total song capacity",
    "configuration_type": "scalar_parameter"
  },
  "Max_Songs_Per_Artist": {
    "sample_value": 3,
    "data_type": "INTEGER",
    "business_meaning": "Maximum number of songs per artist allowed in the festival",
    "optimization_role": "Constraint bound for maximum songs per artist",
    "configuration_type": "scalar_parameter"
  },
  "Min_Artists": {
    "sample_value": 10,
    "data_type": "INTEGER",
    "business_meaning": "Minimum number of artists to be represented in the festival",
    "optimization_role": "Constraint bound for minimum number of artists",
    "configuration_type": "scalar_parameter"
  }
}


TASK: Refine the optimization problem formulation by analyzing current data schema mapping and identifying requirements while maintaining LINEAR structure.

JSON STRUCTURE REQUIRED:

{
  "database_id": "music_4",
  "iteration": 1,
  "business_context": "Updated realistic business scenario description that supports linear optimization",
  "optimization_problem_description": "Refined description of LINEAR optimization problem", 
  "optimization_formulation": {
    "objective": "refined linear minimize/maximize with mathematical precision (sum of weighted variables only)",
    "decision_variables": "clearly defined controllable linear variables (continuous or integer)",
    "constraints": "mathematically precise LINEAR constraint definitions (no variable products or divisions) - maintain 2 to 20 constraints"
  },
  
  "current_optimization_to_schema_mapping": {
    "objective_coefficients": {
      "coefficient_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate",
        "description": "what this coefficient represents in the optimization model"
      }
    },
    "constraint_bounds": {
      "constraint_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate", 
        "description": "what this constraint bound represents"
      }
    },
    "decision_variables": {
      "variable_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate",
        "description": "what this decision variable represents",
        "variable_type": "continuous/integer/binary"
      }
    }
  },
  
  "missing_optimization_requirements": [
    "List what data/parameters are still needed for linear formulation (should be [] if all mappings are good)"
  ],
  
  "iteration_status": {
    "complete": true/false based on linear formulation completeness,
    "confidence": "updated confidence level",
    "next_focus": "What needs refinement for linear optimization OR 'Ready for convergence'"
  }
}

Response:
{
  "database_id": "music_4",
  "iteration": 1,
  "business_context": "A music festival organizer aims to maximize the total number of weeks that songs featured in the festival have spent on top charts, while ensuring diversity among artists and adhering to budget constraints on the number of songs per artist.",
  "optimization_problem_description": "The objective is to maximize the total weeks on top charts for songs selected for the festival. Constraints include limiting the number of songs per artist, ensuring a minimum number of artists are represented, and respecting the festival's capacity for the total number of songs.",
  "optimization_formulation": {
    "objective": "maximize \u2211(Weeks_on_Top \u00d7 x_song)",
    "decision_variables": "x_song: binary decision variable indicating whether a song is selected for the festival",
    "constraints": [
      "\u2211(x_song) \u2264 Total_Song_Capacity",
      "\u2211(x_song per artist) \u2264 Max_Songs_Per_Artist",
      "\u2211(unique artists represented by selected songs) \u2265 Min_Artists"
    ]
  },
  "current_optimization_to_schema_mapping": {
    "objective_coefficients": {
      "Weeks_on_Top[song]": {
        "currently_mapped_to": "volume.Weeks_on_Top",
        "mapping_adequacy": "good",
        "description": "Number of weeks the song has been on top charts"
      }
    },
    "constraint_bounds": {
      "Total_Song_Capacity": {
        "currently_mapped_to": "business_configuration_logic.Total_Song_Capacity",
        "mapping_adequacy": "good",
        "description": "Maximum number of songs the festival can include"
      },
      "Max_Songs_Per_Artist": {
        "currently_mapped_to": "business_configuration_logic.Max_Songs_Per_Artist",
        "mapping_adequacy": "good",
        "description": "Maximum number of songs per artist allowed in the festival"
      },
      "Min_Artists": {
        "currently_mapped_to": "business_configuration_logic.Min_Artists",
        "mapping_adequacy": "good",
        "description": "Minimum number of artists to be represented in the festival"
      }
    },
    "decision_variables": {
      "x_song[song]": {
        "currently_mapped_to": "song_selection.x_song",
        "mapping_adequacy": "good",
        "description": "Binary decision variable indicating whether a song is selected for the festival",
        "variable_type": "binary"
      }
    }
  },
  "missing_optimization_requirements": [],
  "iteration_status": {
    "complete": true,
    "confidence": "high",
    "next_focus": "Ready for convergence"
  }
}
