Iteration 1 - OR_EXPERT_REFINEMENT
Sequence: 3
Timestamp: 2025-07-25 22:28:42

Prompt:
You are an Operations Research (OR) expert in iteration 1 of an alternating optimization process. The algorithm alternates between OR expert analysis and data engineering implementation until convergence.

CRITICAL MATHEMATICAL CONSTRAINTS FOR LINEAR/MIXED-INTEGER PROGRAMMING:
- The optimization problem MUST remain Linear Programming (LP) or Mixed-Integer Programming (MIP)
- Objective function MUST be linear: minimize/maximize ∑(coefficient × variable)
- All constraints MUST be linear: ∑(coefficient × variable) ≤/≥/= constant
- Decision variables can be continuous (LP) or mixed continuous/integer (MIP)
- NO variable products, divisions, or other nonlinear relationships
- If previous iteration introduced nonlinear elements, redesign as linear formulation
- Maintain between 2 and 20 constraints for optimization feasibility

YOUR SCOPE: Focus exclusively on optimization modeling and mapping analysis. Do NOT propose database changes.
ROW COUNT AWARENESS: Understand that data engineer applies 3-row minimum rule - insufficient table data gets moved to business_configuration_logic.json.


DATA AVAILABILITY CHECK: 
Before listing missing requirements, verify:
- Check current schema for required data columns
- Check business configuration logic for required parameters  
- Only list as "missing" if data is truly unavailable
- If all mappings are "good", missing_requirements should be []

CONSISTENCY RULES:
- IF all mapping_adequacy == "good" THEN missing_optimization_requirements = []
- IF missing_optimization_requirements = [] THEN complete CAN be true
- IF complete == true THEN confidence should be "high"

SELF-CHECK: Before responding, verify:
1. Does current schema contain the data I claim is missing?
2. Are my mapping assessments consistent with missing requirements?
3. Is my complete status consistent with missing requirements?

MAPPING COMPLETENESS CHECK: Ensure logical consistency between:
- All objective coefficients mapped with adequacy evaluation
- All constraint bounds mapped with adequacy evaluation  
- All decision variables mapped with adequacy evaluation
- Missing requirements list matches inadequate mappings only


CRITICAL: Respond with ONLY a valid JSON object. No explanations, no markdown, no extra text.



CURRENT STATE (iteration 0):
{
  "iteration": 1,
  "converged": false,
  "business_context": "A music streaming platform aims to optimize its storage and bandwidth usage by selecting a subset of songs to store locally on servers, minimizing the total file size while ensuring a diverse and high-quality music library.",
  "optimization_problem": "The platform wants to minimize the total file size of songs stored locally, subject to constraints on the minimum number of songs per genre, the minimum average rating of songs, and the maximum number of songs per artist.",
  "objective": "minimize \u2211(file_size_i \u00d7 x_i), where x_i is a binary decision variable indicating whether song i is stored locally.",
  "table_count": 2,
  "key_changes": [
    "Schema changes include creating new tables for decision variables and constraints, moving scalar parameters to business_configuration_logic.json, and updating the data dictionary to reflect optimization mappings."
  ],
  "math_consistency": "high",
  "next_iteration_focus": "Refine constraints and ensure all necessary parameters are available for the optimization model.",
  "mapping_adequacy_summary": "needs_improvement"
}

CURRENT SCHEMA:
```sql
-- Iteration 1 Database Schema
-- Objective: Schema changes include creating new tables for decision variables and constraints, moving scalar parameters to business_configuration_logic.json, and updating the data dictionary to reflect optimization mappings.

CREATE TABLE files (
  file_size INTEGER,
  is_stored_locally BOOLEAN
);

CREATE TABLE decision_variables (
  song_id INTEGER,
  is_stored_locally BOOLEAN
);

CREATE TABLE constraints (
  constraint_type STRING,
  constraint_value INTEGER
);


```

CURRENT DATA DICTIONARY:
{
  "tables": {
    "files": {
      "business_purpose": "Stores metadata about songs, including file size and storage decision.",
      "optimization_role": "objective_coefficients, decision_variables",
      "columns": {
        "file_size": {
          "data_type": "INTEGER",
          "business_meaning": "File size of the song in MB.",
          "optimization_purpose": "Coefficient in the objective function.",
          "sample_values": "5, 10, 15"
        },
        "is_stored_locally": {
          "data_type": "BOOLEAN",
          "business_meaning": "Indicates whether the song is stored locally.",
          "optimization_purpose": "Decision variable x_i.",
          "sample_values": "true, false"
        }
      }
    },
    "decision_variables": {
      "business_purpose": "Binary decision variables for song storage.",
      "optimization_role": "decision_variables",
      "columns": {
        "song_id": {
          "data_type": "INTEGER",
          "business_meaning": "Unique identifier for each song.",
          "optimization_purpose": "Index for decision variable x_i.",
          "sample_values": "1, 2, 3"
        },
        "is_stored_locally": {
          "data_type": "BOOLEAN",
          "business_meaning": "Indicates whether the song is stored locally.",
          "optimization_purpose": "Decision variable x_i.",
          "sample_values": "true, false"
        }
      }
    },
    "constraints": {
      "business_purpose": "Constraints for the optimization problem.",
      "optimization_role": "constraint_bounds",
      "columns": {
        "constraint_type": {
          "data_type": "STRING",
          "business_meaning": "Type of constraint (e.g., genre, artist).",
          "optimization_purpose": "Identifies the constraint type.",
          "sample_values": "genre, artist"
        },
        "constraint_value": {
          "data_type": "INTEGER",
          "business_meaning": "Value of the constraint (e.g., minimum songs per genre).",
          "optimization_purpose": "Bound for the constraint.",
          "sample_values": "10, 5"
        }
      }
    }
  }
}


CURRENT BUSINESS CONFIGURATION LOGIC:
{
  "min_songs": {
    "sample_value": 100,
    "data_type": "INTEGER",
    "business_meaning": "Minimum number of songs to store locally.",
    "optimization_role": "Constraint bound for total songs stored.",
    "configuration_type": "scalar_parameter"
  },
  "min_avg_rating": {
    "sample_value": 4.0,
    "data_type": "FLOAT",
    "business_meaning": "Minimum average rating of stored songs.",
    "optimization_role": "Constraint bound for average rating.",
    "configuration_type": "scalar_parameter"
  },
  "max_songs_per_artist": {
    "sample_value": 5,
    "data_type": "INTEGER",
    "business_meaning": "Maximum number of songs per artist to store locally.",
    "optimization_role": "Constraint bound for songs per artist.",
    "configuration_type": "scalar_parameter"
  },
  "min_songs_per_genre": {
    "sample_value": 10,
    "data_type": "INTEGER",
    "business_meaning": "Minimum number of songs per genre to store locally.",
    "optimization_role": "Constraint bound for songs per genre.",
    "configuration_type": "scalar_parameter"
  }
}


TASK: Refine the optimization problem formulation by analyzing current data schema mapping and identifying requirements while maintaining LINEAR structure.

JSON STRUCTURE REQUIRED:

{
  "database_id": "music_1",
  "iteration": 1,
  "business_context": "Updated realistic business scenario description that supports linear optimization",
  "optimization_problem_description": "Refined description of LINEAR optimization problem", 
  "optimization_formulation": {
    "objective": "refined linear minimize/maximize with mathematical precision (sum of weighted variables only)",
    "decision_variables": "clearly defined controllable linear variables (continuous or integer)",
    "constraints": "mathematically precise LINEAR constraint definitions (no variable products or divisions) - maintain 2 to 20 constraints"
  },
  
  "current_optimization_to_schema_mapping": {
    "objective_coefficients": {
      "coefficient_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate",
        "description": "what this coefficient represents in the optimization model"
      }
    },
    "constraint_bounds": {
      "constraint_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate", 
        "description": "what this constraint bound represents"
      }
    },
    "decision_variables": {
      "variable_name[indices]": {
        "currently_mapped_to": "table.column OR business_configuration_logic.key OR missing",
        "mapping_adequacy": "good/missing/redundant/partial/inaccurate",
        "description": "what this decision variable represents",
        "variable_type": "continuous/integer/binary"
      }
    }
  },
  
  "missing_optimization_requirements": [
    "List what data/parameters are still needed for linear formulation (should be [] if all mappings are good)"
  ],
  
  "iteration_status": {
    "complete": true/false based on linear formulation completeness,
    "confidence": "updated confidence level",
    "next_focus": "What needs refinement for linear optimization OR 'Ready for convergence'"
  }
}

Response:
{
  "database_id": "music_1",
  "iteration": 1,
  "business_context": "A music streaming platform aims to optimize its storage and bandwidth usage by selecting a subset of songs to store locally on servers, minimizing the total file size while ensuring a diverse and high-quality music library.",
  "optimization_problem_description": "Minimize the total file size of songs stored locally, subject to constraints on the minimum number of songs per genre, the minimum average rating of songs, and the maximum number of songs per artist.",
  "optimization_formulation": {
    "objective": "minimize \u2211(file_size_i \u00d7 x_i), where x_i is a binary decision variable indicating whether song i is stored locally.",
    "decision_variables": "x_i \u2208 {0, 1} for each song i, indicating whether the song is stored locally.",
    "constraints": [
      "\u2211(x_i) \u2265 min_songs (minimum total songs stored)",
      "\u2211(rating_i \u00d7 x_i) / \u2211(x_i) \u2265 min_avg_rating (minimum average rating)",
      "\u2211(x_i) \u2264 max_songs_per_artist for each artist (maximum songs per artist)",
      "\u2211(x_i) \u2265 min_songs_per_genre for each genre (minimum songs per genre)"
    ]
  },
  "current_optimization_to_schema_mapping": {
    "objective_coefficients": {
      "file_size_i": {
        "currently_mapped_to": "files.file_size",
        "mapping_adequacy": "good",
        "description": "File size of song i in MB."
      }
    },
    "constraint_bounds": {
      "min_songs": {
        "currently_mapped_to": "business_configuration_logic.min_songs",
        "mapping_adequacy": "good",
        "description": "Minimum number of songs to store locally."
      },
      "min_avg_rating": {
        "currently_mapped_to": "business_configuration_logic.min_avg_rating",
        "mapping_adequacy": "good",
        "description": "Minimum average rating of stored songs."
      },
      "max_songs_per_artist": {
        "currently_mapped_to": "business_configuration_logic.max_songs_per_artist",
        "mapping_adequacy": "good",
        "description": "Maximum number of songs per artist to store locally."
      },
      "min_songs_per_genre": {
        "currently_mapped_to": "business_configuration_logic.min_songs_per_genre",
        "mapping_adequacy": "good",
        "description": "Minimum number of songs per genre to store locally."
      }
    },
    "decision_variables": {
      "x_i": {
        "currently_mapped_to": "decision_variables.is_stored_locally",
        "mapping_adequacy": "good",
        "description": "Binary decision variable indicating whether song i is stored locally.",
        "variable_type": "binary"
      }
    }
  },
  "missing_optimization_requirements": [],
  "iteration_status": {
    "complete": true,
    "confidence": "high",
    "next_focus": "Ready for convergence"
  }
}
