Assessment data for international cognitive ability resource 2014-2018

DOI

The data is categorised by item types. Each folder contains datasets for one item type, including the item-level data, the participants information, and the item files. There are 8 folders in total, contributing data for 2d rotation test, 3d rotation test, face detection test, matrices reasoning test, perceptual maze test, two number series tests, and linear syllogism test.After more than a century of active research on cognitive abilities, there now exist dozens of assessment tools of tremendous variety. Many of these are no longer widely used on account of being outdated or poorly maintained. Most of the remainder - those tests which are actively used and well maintained - can generally be organized into two broad types: (i) proprietary measures owned and administered by profitable commercial entities or (ii) idiosyncratic measures which are usually developed and used by isolated research groups for narrow purposes. This circumstance is problematic for the international community of cognitive ability researchers because it inhibits the generalization of findings across sub-fields and, more generally, slows the pace at which knowledge can advance. The tangible consequences of this circumstance on the societal level are manifested through limited utility of cognitive ability assessment in clinical settings (as used for diagnoses of cognitive impairment) and selection contexts (as used for personnel recruitment or academic admissions). These consequences will be addressed by the development of the International Cognitive Ability Resource (ICAR), a public-domain and open-source tool which will incorporate modern item generation and adaptive testing techniques. At its essence, ICAR is a framework for international collaboration. This framework will facilitate the development of a large and dynamic bank of cognitive ability measures for use in a wide variety of applications. By encouraging the use, revision, and ongoing development of these measures among qualified research groups around the world, the ICAR will further understanding about the structure of cognitive abilities as well as the nature of associations between cognitive ability constructs and the life outcomes they predict. This framework is not without precedent; a similar project has been implemented for use in psychology. The International Personality Item Pool (IPIP) is a large collection of publicly available personality items which was introduced to resolve similar problems with measurement standards. This project has met with considerable success; data collected with IPIP measures have contributed to more than 500 journal articles and book chapters over the last decade. The proposed ICAR is not entirely analogous, mainly because cognitive ability items are fundamentally different from typical, self-report personality items. While the latter are measures of typical behaviour, most intelligence items are intended to assess maximal performance. This distinction makes the development of ICAR considerably more challenging, though it has already been demonstrated that such development is feasible. The development project proposed herein will result in a resource which contains many types of item generators. These will be distributed as functions in psychometrically informed, easily implemented, open-source software. Research groups will be able to use these item generators by downloading the software through the widely-used, open-source statistical software platform, R. As needed, the revision of existing item generators and the development of additional types will be encouraged among qualified international researchers. These item generators will be well suited for large scale, international data collection as might be conducted over the internet.

Data was collected over the internet. Participants came from all over the world. The matrices test was delivered by discovermyprofile.com, whereas all the other tests were implemented on the Concerto testing platform and distributed via university email lists, discovermyprofile.com and social networks.

Identifier
DOI https://doi.org/10.5255/UKDA-SN-853245
Metadata Access https://datacatalogue.cessda.eu/oai-pmh/v0/oai?verb=GetRecord&metadataPrefix=oai_ddi25&identifier=9ebcb34fd1e03ac905b06b55d88f5c903db7b3d9192518d35f26ed4cfe1a17a9
Provenance
Creator Rust, J, University of Cambridge; Sun, L, University of Cambridge; Loe, B, University of Cambridge; Chan, Y, University of Cambridge; Verhallen, R, University of Cambridge
Publisher UK Data Service
Publication Year 2018
Funding Reference Economic and Social Research Council
Rights John Rust, University of Cambridge. Luning Sun, University of Cambridge. Baosheng Loe, University of Cambridge. YWF Chan, University of Cambridge. Roeland Verhallen, University of Cambridge; The Data Collection is available for download to users registered with the UK Data Service.
OpenAccess true
Representation
Language English
Resource Type Numeric; Still image; Other
Discipline Psychology; Social and Behavioural Sciences
Spatial Coverage United Kingdom; United States; Other countries