Iteration 2 - OR_EXPERT_REFINEMENT
Sequence: 5
Timestamp: 2025-07-27 21:59:36

Prompt:
You are an Operations Research (OR) expert in iteration 2 of an alternating optimization process. The algorithm alternates between OR expert analysis and data engineering implementation until convergence.

CRITICAL MATHEMATICAL CONSTRAINTS FOR LINEAR/MIXED-INTEGER PROGRAMMING:
- The optimization problem MUST remain Linear Programming (LP) or Mixed-Integer Programming (MIP)
- Objective function MUST be linear: minimize/maximize ∑(coefficient × variable)
- All constraints MUST be linear: ∑(coefficient × variable) ≤/≥/= constant
- Decision variables can be continuous (LP) or mixed continuous/integer (MIP)
- NO variable products, divisions, or other nonlinear relationships
- If previous iteration introduced nonlinear elements, redesign as linear formulation
- Maintain between 2 and 20 constraints for optimization feasibility

YOUR SCOPE: Focus exclusively on optimization modeling and mapping analysis. Do NOT propose database changes.
ROW COUNT AWARENESS: Understand that data engineer applies 3-row minimum rule - insufficient table data gets moved to business_configuration_logic.json.


DATA AVAILABILITY CHECK: 
Before listing missing requirements, verify:
- Check current schema for required data columns
- Check business configuration logic for required parameters  
- Only list as "missing" if data is truly unavailable
- If all mappings are "good", missing_requirements should be []

CONSISTENCY RULES:
- IF all mapping_adequacy == "good" THEN missing_optimization_requirements = []
- IF missing_optimization_requirements = [] THEN complete CAN be true
- IF complete == true THEN confidence should be "high"

SELF-CHECK: Before responding, verify:
1. Does current schema contain the data I claim is missing?
2. Are my mapping assessments consistent with missing requirements?
3. Is my complete status consistent with missing requirements?

MAPPING COMPLETENESS CHECK: Ensure logical consistency between:
- All objective coefficients mapped with adequacy evaluation
- All constraint bounds mapped with adequacy evaluation  
- All decision variables mapped with adequacy evaluation
- Missing requirements list matches inadequate mappings only


CRITICAL: Respond with ONLY a valid JSON object. No explanations, no markdown, no extra text.



CURRENT STATE (iteration 1):
{
  "iteration": 2,
  "converged": false,
  "business_context": "A music festival organizer wants to maximize the exposure of artists by selecting the optimal set of artists to perform at a festival, considering their popularity and availability.",
  "optimization_problem": "The goal is to maximize the total weeks on top of the charts for the selected artists while ensuring that the total number of artists selected does not exceed the festival's capacity and that each artist is available on the festival date.",
  "objective": "maximize total_weeks_on_top = \u2211(Weeks_on_Top[i] * x[i])",
  "table_count": 1,
  "key_changes": [
    "Added Weeks_on_Top table to address missing data for objective coefficients, updated data dictionary, and adjusted business configuration logic for scalar parameters."
  ],
  "math_consistency": "high",
  "next_iteration_focus": "Incorporate Weeks_on_Top data for each artist into the model",
  "mapping_adequacy_summary": "partially_adequate"
}

CURRENT SCHEMA:
```sql
-- Iteration 2 Database Schema
-- Objective: Added Weeks_on_Top table to address missing data for objective coefficients, updated data dictionary, and adjusted business configuration logic for scalar parameters.

CREATE TABLE artist (
  Artist_ID INTEGER,
  Availability_Status BOOLEAN
);

CREATE TABLE artist_weeks_on_top (
  Artist_ID INTEGER,
  Weeks_on_Top INTEGER
);

CREATE TABLE festival_capacity (
  Capacity INTEGER
);


```

CURRENT DATA DICTIONARY:
{
  "tables": {
    "artist": {
      "business_purpose": "Stores information about artists",
      "optimization_role": "decision_variables",
      "columns": {
        "Artist_ID": {
          "data_type": "INTEGER",
          "business_meaning": "Unique identifier for each artist",
          "optimization_purpose": "Used as a decision variable in the optimization model",
          "sample_values": "1, 2, 3"
        },
        "Availability_Status": {
          "data_type": "BOOLEAN",
          "business_meaning": "Indicates if the artist is available on the festival date",
          "optimization_purpose": "Used to enforce availability constraint",
          "sample_values": "true, false"
        }
      }
    },
    "artist_weeks_on_top": {
      "business_purpose": "Stores the number of weeks each artist was on top of the charts",
      "optimization_role": "objective_coefficients",
      "columns": {
        "Artist_ID": {
          "data_type": "INTEGER",
          "business_meaning": "Unique identifier for each artist",
          "optimization_purpose": "Links to artist table for objective coefficient",
          "sample_values": "1, 2, 3"
        },
        "Weeks_on_Top": {
          "data_type": "INTEGER",
          "business_meaning": "Number of weeks the artist was on top of the charts",
          "optimization_purpose": "Used as an objective coefficient in the optimization model",
          "sample_values": "5, 10, 15"
        }
      }
    },
    "festival_capacity": {
      "business_purpose": "Stores the maximum number of artists for the festival",
      "optimization_role": "constraint_bounds",
      "columns": {
        "Capacity": {
          "data_type": "INTEGER",
          "business_meaning": "Maximum number of artists that can be selected",
          "optimization_purpose": "Used as a constraint bound in the optimization model",
          "sample_values": "10"
        }
      }
    }
  }
}



TASK: Refine the optimization problem formulation by analyzing current data schema mapping and identifying requirements while maintaining LINEAR structure.

JSON STRUCTURE REQUIRED:

{
  "database_id": "music_4",
  "iteration": 2,
  "business_context": "Updated realistic business scenario description that supports linear optimization",
  "optimization_problem_description": "Refined description of LINEAR optimization problem", 
  "optimization_formulation": {
    "objective": "refined linear minimize/maximize with mathematical precision (sum of weighted variables only)",
    "decision_variables": "clearly defined controllable linear variables (continuous or integer)",
    "constraints": "mathematically precise LINEAR constraint definitions (no variable products or divisions) - maintain 2 to 20 constraints"
  },
  
  "current_optimization_to_schema_mapping": {
    "objective_coefficients": {
      "coefficient_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate",
        "description": "what this coefficient represents in the optimization model"
      }
    },
    "constraint_bounds": {
      "constraint_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate", 
        "description": "what this constraint bound represents"
      }
    },
    "decision_variables": {
      "variable_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate",
        "description": "what this decision variable represents",
        "variable_type": "continuous/integer/binary"
      }
    }
  },
  
  "missing_optimization_requirements": [
    "List what data/parameters are still needed for linear formulation (should be [] if all mappings are good)"
  ],
  
  "iteration_status": {
    "complete": true/false based on linear formulation completeness,
    "confidence": "updated confidence level",
    "next_focus": "What needs refinement for linear optimization OR 'Ready for convergence'"
  }
}

Response:
{
  "database_id": "music_4",
  "iteration": 2,
  "business_context": "A music festival organizer wants to maximize the exposure of artists by selecting the optimal set of artists to perform at a festival, considering their popularity and availability.",
  "optimization_problem_description": "Maximize the total weeks on top of the charts for selected artists while ensuring the number of artists does not exceed festival capacity and each artist is available.",
  "optimization_formulation": {
    "objective": "maximize total_weeks_on_top = \u2211(artist_weeks_on_top.Weeks_on_Top[i] * x[i])",
    "decision_variables": "x[i] is a binary variable indicating if artist i is selected (1 if selected, 0 otherwise)",
    "constraints": [
      "\u2211(x[i]) \u2264 festival_capacity.Capacity",
      "x[i] \u2264 artist.Availability_Status[i] for all i"
    ]
  },
  "current_optimization_to_schema_mapping": {
    "objective_coefficients": {
      "Weeks_on_Top[i]": {
        "currently_mapped_to": "artist_weeks_on_top.Weeks_on_Top",
        "mapping_adequacy": "good",
        "description": "Number of weeks artist i was on top of the charts"
      }
    },
    "constraint_bounds": {
      "Capacity": {
        "currently_mapped_to": "festival_capacity.Capacity",
        "mapping_adequacy": "good",
        "description": "Maximum number of artists that can be selected"
      }
    },
    "decision_variables": {
      "x[i]": {
        "currently_mapped_to": "artist.Artist_ID",
        "mapping_adequacy": "good",
        "description": "Binary variable indicating if artist i is selected",
        "variable_type": "binary"
      }
    }
  },
  "missing_optimization_requirements": [],
  "iteration_status": {
    "complete": true,
    "confidence": "high",
    "next_focus": "Ready for convergence"
  }
}
