Configuration 1: bert on use with cosine distance
Configuration 2: xlnet on use with cosine distance
Testing on: combined queries for the student_perf schema
Entries below have greater num_guesses with a threshold of 3
--------------------------------------------------
--------------------------------------------------

Query (#1): Predict the average final grade of students
Ground Truth (filter): NONE

Annotation 1: []
Annotation 2: []

Configuration 1 took 35 attempt(s) to get the correct answer
Configuration 2 took 1 attempt(s) to get the correct answer

--------------------------------------------------

Query (#2): Predict the maximum first period grade of students
Ground Truth (filter): NONE

Annotation 1: []
Annotation 2: [{'text': 'first period grade of students', 'confidence': 0.711448}]

Configuration 1 took 35 attempt(s) to get the correct answer
Configuration 2 took 34 attempt(s) to get the correct answer

--------------------------------------------------

Query (#3): Predict the average second period grade of students
Ground Truth (filter): NONE

Annotation 1: []
Annotation 2: [{'text': 'grade of', 'confidence': 0.7508125}]

Configuration 1 took 35 attempt(s) to get the correct answer
Configuration 2 took 4 attempt(s) to get the correct answer

--------------------------------------------------

Query (#4): Predict the maximum final grade of students where school is Gabriel Pereira
Ground Truth (filter): SCHOOL

Annotation 1: []
Annotation 2: [{'text': 'where school', 'confidence': 0.99653625}]

Configuration 1 took 1 attempt(s) to get the correct answer
Configuration 2 took 1 attempt(s) to get the correct answer

--------------------------------------------------

Query (#5): Predict the average first period grade of students where school is Mousinho da Silveira
Ground Truth (filter): SCHOOL

Annotation 1: []
Annotation 2: [{'text': 'school', 'confidence': 0.9980263}]

Configuration 1 took 1 attempt(s) to get the correct answer
Configuration 2 took 1 attempt(s) to get the correct answer

--------------------------------------------------

Query (#6): Predict the average final grade of students where student is male for next year
Ground Truth (filter): SEX

Annotation 1: []
Annotation 2: [{'text': 'student', 'confidence': 0.9878804}]

Configuration 1 took 3 attempt(s) to get the correct answer
Configuration 2 took 2 attempt(s) to get the correct answer

--------------------------------------------------

Query (#7): Predict the maximum final grade of students where student’s home address is in rural area for next two years
Ground Truth (filter): ADDRESS

Annotation 1: []
Annotation 2: [{'text': 'student’s home address is in rural area', 'confidence': 0.91161644}]

Configuration 1 took 5 attempt(s) to get the correct answer
Configuration 2 took 1 attempt(s) to get the correct answer

--------------------------------------------------

Query (#8): Predict the average first period grade of students where student’s family size is greater than 3 for next year
Ground Truth (filter): FAMSIZE

Annotation 1: []
Annotation 2: [{'text': 'student’s family size', 'confidence': 0.9962513}]

Configuration 1 took 6 attempt(s) to get the correct answer
Configuration 2 took 1 attempt(s) to get the correct answer

--------------------------------------------------

