Concept map / Person–item map

Share

Person–item maps and test targeting

Compare examinee abilities with item difficulties on a common scale and inspect where measurement is most precise.

1Is this test aimed at these students?

An eight-item reading test was written for students in the middle of the scale. A teacher wants to give it to beginning readers. Will it measure them well? Item information says precision depends on how close the items sit to each student, so the question is where the items sit relative to the group.

A person–item map, or Wright map, shows that at a glance. Under the Rasch model, ability θ and difficulty b share one scale in logits (log-odds units), so students and items go on the same vertical ruler. Switch groups, shift the items, and move θ to see the standard error, the margin of error of an ability estimate, change.

Logits: ability θ and difficulty b on one scaleStudentsItems−4−3−2−101234Group meanItem mean
One student, rounded to the nearest half logitOne itemWithin 0.75 logits of the inspected ability
012−4−2024Standard error of abilityAbility θ
Standard error for the current itemsSmallest standard errorStudents in this group

The beginning readers average −1.60 and the items average 0.84, so the items sit 2.44 logits above the group. At θ = −1.6, 0 of 8 items lie within 0.75 logits and the standard error is 1.21. Averaged over the group it is 1.30, against 0.81 for the advanced readers.

2What “above an item” means

On the map, a student sits exactly 1 logit above an item. Under the Rasch model, what is that student’s chance of answering the item correctly?

3Why the gap sets precision

Under the Rasch model every item has discrimination 1, so only the gap θ − b matters. Each item adds P(1 − P) to the information at θ: 0.25 when the item sits exactly at θ, close to zero when it sits far above or below. Point at a symbol to light up its part of the map.

Pi(θ)=11+e−(θ−bi),SE(θ)=1∑iPi(θ) [1−Pi(θ)]P_i(\htmlClass{term-theta}{\theta}) = \frac{1}{1 + e^{-(\htmlClass{term-theta}{\theta} - \htmlClass{term-b}{b_i})}}, \qquad \text{SE}(\htmlClass{term-theta}{\theta}) = \frac{1}{\sqrt{\sum_i P_i(\theta)\,[1 - P_i(\theta)]}}
Pi(θ)=11+e−(θ−bi)SE(θ)=1∑iPi(θ) [1−Pi(θ)]\begin{gathered} P_i(\htmlClass{term-theta}{\theta}) = \frac{1}{1 + e^{-(\htmlClass{term-theta}{\theta} - \htmlClass{term-b}{b_i})}} \\[6pt] \text{SE}(\htmlClass{term-theta}{\theta}) = \frac{1}{\sqrt{\sum_i P_i(\theta)\,[1 - P_i(\theta)]}} \end{gathered}
SE(−1.6)=10.18+0.14+0.11+0.08+0.06+0.05+0.03+0.02=10.69=1.21\text{SE}(\htmlClass{term-theta}{-1.6}) = \frac{1}{\sqrt{0.18 + 0.14 + 0.11 + 0.08 + 0.06 + 0.05 + 0.03 + 0.02}} = \frac{1}{\sqrt{0.69}} = 1.21
∑iPi(1−Pi)=0.18+0.14+0.11+0.08+0.06+0.05+0.03+0.02=0.69SE(−1.6)=10.69=1.21\begin{aligned} \textstyle\sum_i P_i(1 - P_i) &= 0.18 + 0.14 + 0.11 + 0.08 \\ &\quad + 0.06 + 0.05 + 0.03 + 0.02 \\ &= 0.69 \\[4pt] \text{SE}(\htmlClass{term-theta}{-1.6}) &= \frac{1}{\sqrt{0.69}} = 1.21 \end{aligned}

Items far from θ = −1.6 add almost nothing to the sum, so a test aimed at another group measures this student poorly.

4Check yourself

Each task ticks itself when the lab meets its condition.

  • With the beginning readers, shift the items until the mean item difficulty is within 0.10 of the group’s mean ability.Now: Beginning readers, group mean −1.60, item mean 0.84, gap 2.44
  • Find one shift that keeps the average standard error below 1.00 for both groups at once.Now: shift 0.0: beginning 1.30, advanced 0.81
  • Set the shift back to zero, then move the inspected ability to where the standard error is smallest (to three decimals). Compare that ability with the item mean.Now: shift 0.0, standard error 1.208 at θ = −1.6; smallest 0.760 at θ = 0.8

5Person and item locations from mirt

The code simulates 500 beginning readers (mean ability −1.6, as in the lab) answering the eight items, fits a Rasch model with mirt, and prints both sides of the map. mirt fixes the group’s mean ability at 0, so every item comes out about 2.4 logits higher than on the page. The mean item difficulty, 2.43, is the gap between items and group; the lab shows 2.44. Most students answer none or one item correctly, so the person estimates take only a few values: −0.75 for zero correct and 0.56 for one.

Fit a Rasch model and print person and item locationsShow the code
library(mirt)

# Eight Rasch items and 500 beginning readers, as on the page
set.seed(3)
b <- c(-0.4, 0, 0.3, 0.7, 1, 1.3, 1.7, 2.1)
theta <- rnorm(500, mean = -1.6, sd = 0.6)
p <- plogis(outer(theta, b, "-"))
resp <- (matrix(runif(length(p)), nrow(p)) < p) * 1
colnames(resp) <- paste0("Item_", 1:8)

fit <- mirt(resp, 1, itemtype = "Rasch", verbose = FALSE)
# Item locations (difficulty b)
pars <- coef(fit, IRTpars = TRUE, simplify = TRUE)
items <- pars$items[, "b"]
round(items, 2)
# Person locations: weighted likelihood estimates, which
# stay finite for students with no correct answers
persons <- fscores(fit, method = "WLE")[, 1]
round(summary(persons), 2)
# mirt fixes the group's mean ability at 0, so the mean item
# difficulty is how far the items sit above the group
round(mean(items), 2)

Uses mirt. Install once with install.packages(c("mirt")).

What the map tells you about targeting