Using process data to understand adults' problem-solving behaviour in the Programme for the International Assessment of Adult Competencies (PIAAC) Identifying generalised patterns across multiple tasks with sequence mining

The Survey of Adult Skills, a product of the OECD Programme for the International Assessment of Adult Competencies (PIAAC), used computers as the main assessment deliver platform. This enabled the Programme to collect data not only on whether respondents were able to solve specific tasks, but also o...

Full description

Bibliographic Details
Main Author: He, Qiwei
Other Authors: Borgonovi, Francesca, Paccagnella, Marco
Format: eBook
Language:English
Published: Paris OECD Publishing 2019
Series:OECD Education Working Papers
Subjects:
Online Access:
Collection: OECD Books and Papers - Collection details see MPG.ReNa
Description
Summary:The Survey of Adult Skills, a product of the OECD Programme for the International Assessment of Adult Competencies (PIAAC), used computers as the main assessment deliver platform. This enabled the Programme to collect data not only on whether respondents were able to solve specific tasks, but also on how they approached the problems at hand and how much time they spent on them. This paper draws on this information to characterise individuals' problem-solving strategies using the longest common subsequence (LCS) method, a sequence-mining technique commonly used in natural language processing and biostatistics. The LCS is used to compare the action sequences followed by PIAAC respondents to a set of "optimal" predefined sequences identified by test developers and subject matter experts. This approach allows studying problem-solving behaviours across multiple assessment items
Physical Description:50 p