Multiple Choice Responses A B C B B A D C E B A B C C D A A E A B A B C B D B D C C D A A B B C D D C A D A B B C B B B D E B A A C B D A D C D B A B C B D D D D E E B B B C D D D D D B B A C B D D D C E B A A C B D A D D C B A B C B D C D A D E A B B B D A C E E E A B B B C D A E E B A A B A B A E E E B B B C A D A D C A D A B A C D C B C E C A A B B C A D A C E A B A A A A A A E B A B B B D D C C E D A A C B B A A A E B B A B B D D D E E B A A C B D A E A D C A A A A D A E E D A B B A B C D D E E B A B B B D D D C E B A B B B D A B C B E B B C B C A D B E D A B C C C A A A E B A B C A D A D C A B B B C B D B D B E B B B C B A A D E E D B B C A C A E B D C A B C C D A D B E B A B A A D A C C E B B A B B D A C C A B B B C B D B D C A D A B C B A A A C E B A B B A D A B C E E A B B A D A B C C D A B C B A D D B D B A A B B B D E A E B A B C B D A D C E A A B B C D C B C E B A B B B D D D C E C A A A A C A D C A B A A C A D D C C D A B B C A C B B D A C B B C B D A D C E D A B C B B A D C A A A A C B D B B C D D Correct Answers Percentile to Mark High and Low Scores

Data Input for Evaluating Multiple Choice questions     The data is a table of answers     Each row is from a response     Each column from a question, separated by spaces or tabs     Each cell the answer provided for that question by that response Correct Answers     The correct answer for each question, separated by spaces or tabs Percentile to mark low and high scorers     Use value >0 to <=50.

This panel provides supports for data entry and interpretation of results only. Detailed discussions on Item Analysis for Multiple Choice Questions are provided in the Item Analysis for Multiple Choice Questions Explanation Page

Data Entry

Three (3) sets of data are required

Multiple Choice Responses is a table of test data for item analysis.

• The rows are responses, each row from a subject
• The columns are questions or items, each from a question in the in the test. The columns are separated by spaces or tabs
• The cells are answers, each from that question and that response. The answers an be any text (single word with no gaps). However, as most multiple choice questions answers are single capital letters (A,B,C ... etc), single capital letters are usually used

Correct Answers is a single row of text separated by spaces or tabs. The number of text must be the same as the number of columns in the data, and each text (or letter in most cases) represents the correct answer for the corresponding question

Percentile is the percentile used to identify the high and low scorers for the purpose of estimating the difficulty and discrimination ideces. The recommended value is 27% (and its correcponsing (100-27=73%) for low and high scorers. This default value should be used unless the users has reasons to change it. More discussions on this issue are provided in the Item Analysis for Multiple Choice Questions Explanation Page

Default Example Data

The default example data are artificially created to demonstrate the algorithm, and does not reflect reality. It purports to be the results of a multiple choice test, using 10 questions and on 50 students (responses).

• Questions 1 and 2 are old fashion x type 2 options (true or false) binary responses (A and B)
• Questions 3 and 4 have 3 options
• Questions 5 and 6 have 4 options
• Questions 7 to 10 have 5 options

The correct answer for the 10 questions are A B C B D A D C E B

Percentile setting to identify high and low scorers is set at 27

Please note: The data was generated using random numbers so that the proportions of correct answers were set at arounf 0.5. This results in the indeces calculated to be lower than expected from a real set of multiple choice questions. Users should not be confused and think the level of difficulties and discrimination presented on this page are at the expected level.

Results

Detailed explanation of resuklts are presented in the Item Analysis for Multiple Choice Questions Explanation Page . The following are summary descriptions

Table 1 displays the number (count) and proportion (p) for each answer in each question, matching against the proportion if the answers were randomly chosen.

Table 2 displays the score (n) and proportion of correct answers from each response (row), and the label as low (L) , high (H), or medium (M) scorers

Table 3 displays the number (N_correct) ane proportion (p_correct) of correct answers for each question, and matching these against the proportion if the question is answered in random (p_random), and the rheoretically ideal proportion (p_ideal)

Table 4 displays the results of item analysis for each question. Detailed descriptions are presented in the Item Analysis for Multiple Choice Questions Explanation Page .

References

Calculations are based on that described in the web page http://www.ericae.net/ft/tamu/Espy.htm