Supplemental Information:

• Engagement_Survey.pdf (254 KB) Download

Assessment Type:

Survey

Scale:

4-point Likert scale

Publication Date:

Aug 21, 2016

Respondent:

See comment section

Domain(s) Evaluated:

Engagement, Attitude / Behavior

Sample items:

During this activity:
I was focused on the things we were learning most of the time.

Reliability:

See comment section

Validity:

See comment section

Frequency:

Rarely

Administration time:

<15 minutes

Requires a Computer:

No

Requires Internet Access:

No

Primary reference:

Chung, J., Cannady, M. A., Schunn, C., Dorph, R., & Bathgate, M., (2016) Measures technical brief: engagement in science learning activities. Retrieved from: http://www.pearweb.org/atis/data/documents/000/000/075/Engagement_Survey.pdf?1574800206

Comments:

Respondents:
The Engagement survey was written for use with 10-14 year-old respondents immediately after a science activity, whether in a class or in an informal learning context. Such contextualized and immediate use of minimizes memory biases or inferences based on beliefs the learner has about themselves or the learning context. Accordingly, it should be used after a focused science activity rather than as a measure of a general engagement.

Reliability:
Both the raw Cronbach’s alpha and polychromic alpha coefficients using all eight of the Engagement items were found to be good (0.80 and 0.85 separately). All items contribute positively to the reliability of the scale, implying that all items contribute to the cohesiveness of the scale.

Validity:
The Rasch Model was used to test the validity and the eight Engagement items were fit to the partial credit Rasch model using ConQuest and examined for significant deviations in the unweighted (outfit) and weighted (infit) mean square error statistics. Infit and Outfit levels between 0.6 and 1.4 are generally considered satisfactorily fitting the Rasch model for rating scales.

STEM Criteria

Science

Yes

Technology

No

Engineering

No

Math

No