Psychometrics and psychological diagnosis 2

Psychometrics and psychological diagnosis 1 WF-PS-N-PSM1

intermediate

PS_W06

PS_W16

PS_U03

PS_U08

The course in Psychometry consists of 60 hours of lectures and 60 hours of practical classes. The course lasts for two semesters.

The main goal of the lecture is to familiarize students with theories of measurement in psychology, in particular with classical measurement theory. Students will be familiarized with various types of psychological tests, methods of their construction and methods of characterizing their psychometric properties.

After completing the course, students should be able to: assess the correctness of the psychological tools (such as psychological tests) used in any psychological examination, make a critical methodological assessment of the quality of research published in psychological literature in respect to what psychometric tools were used and what was their quality, as well as design and perform construction or adaptation of a psychometric test.

Specific objectives of the course in terms of knowledge, skills and competences:

KNOWLEDGE:

The scope of psychometric expertise has fundamentally altered in the last few years. These are not only minor adjustments in the conceptual sphere. The changes were so severe that they challenged conventional understanding of what goodness of measurement is. The main objective of this course is to acquaint students with the methods of constructing psychological tests and with psychometric characteristics of the test – not only according to the classic, but also to the modern (non-classical) theoretical framework. A psychologist should gain a thorough knowledge of the theoretical basis and of interpretation rules of the results of the (main) psychological tests, which are used for diagnosis, selection or to support the therapy. But a psychologist should also be able to apply this knowledge to construct a new psychological test and to assess its psychometric characteristics. A psychology graduate should also be able to adapt the test from foreign culture and language. It is also assumed that he or she is essentially ready to use psychological tests in diagnostic and therapeutic practice

SKILLS:

A psychologist knows how to identify the psychometric test that meets the criteria referred to in the main publication: Standards for tests used in psychology and pedagogy (2007). A psychology graduate knows how to competently use psychological tests in diagnostic practice but also in research. A psychologist is able to assess the appropriateness of any psychological test used, he or she knows how to assess the methodological correctness of the diagnostic interview or observation and critically assess the methodological quality of studies published in the literature. He or she is able to do it using classical and non-classical psychometric theories. A psychology graduate is able to construct the psychological test and is able to adapt one (from different culture or language). Finally, he or she is able to correctly analyse - with reference to the statistical methods - the results of the test, and prepare a multimedia presentation or a talk based on the results.

COMPETENCES:

A psychologist protects psychological tests against individuals and institutions, which – with a free access to the results of testing of certain persons - would violate the principle of confidentiality, and of privacy and dignity of the person tested. A psychology graduate informs authorized persons and institutions about the results of their testing in a responsible manner (in accordance with professional ethics of psychologist).

The basic literature for the course:

Anastasi, A, Urbina, S. (1999). Testy psychologiczne. Warszawa: Pracownia Testów Psychologicznych PTP.

Aranowska, E. (2005). Pomiar ilościowy w psychologii. Warszawa: Wydawnictwo Naukowe SCHOLAR.

Aranowska, E. (1996). Metodologiczne problemy zastosowań modeli statystycznych w psychologii. Teoria i praktyka. Warszawa: Studio 1.

Aranowska,E., Rytel, J. (2013). Kontrowersje wokół rzetelności jako pojęcia psychometrycznego. "Przegląd Psychologiczny", 56 (1), 29-43.

Brzeziński, J. (1997). Metodologia badań psychologicznych. Warszawa: PWN.

Standardy dla testów stosowanych w psychologii i pedagogice (2007), Gdańsk: Gdańskie Wydawnictwo Psychologiczne.

Strelau, J.(red.) (2000). Psychologia. Podręcznik Akademicki. (rozdział 12). Gdańsk: GWP.

Other litereature will be given to the students during the course.

The classes are designed to broaden the student's knowledge, skills and competences, which serve the following general learning outcomes, specified in the learning outcomes for the curriculum in Psychology Master's studies. According to them, the graduate:

- has knowledge of modern research methodology based on advanced statistics and current psychometry (PS_W06)

- has an in depth knowledge of the selected methods and tools for diagnosis and psychological intervention (PS_W16)

- is able to select and use various psychological methods and tests to diagnose human behavior, individual differences and personality, and has the ability to analyse the data using the SPSS statistical package (PS_U03)

- is able to construct and evaluate psychometrically psychological tests (PS_U08)

This overall learning outcomes translate into the following detailed learning outcomes:

Knowledge (after the first semester)

1. The students know what psychometrics is and what is it role for a psychologist.

2. The students know and is able to explain basic psychometric terms.

3. The students are able to give the axioms of classical test theory (CTT). They know what is a true score and an observed score. They are able to show limitations of the CTT.

4. The students are able to characterize the basic methods of how to assess a reliability of a test (according to the CTT), they know what is a standard error of measurement, they are able to name and describe other errors of measurement.

5. The students know what a discriminatory power of the test item and knows the methods of its assessment.

6. The students know and are able to characterize basic methods of how a validity of a test should be assessed (according to CTT).

7. The students know the basics of a factor analysis and of a principal components analysis.

Skills (after the first semester)

1. The students are able to identify the psychometric test that meets the criteria of CTT referred to in the main publication: Standards for tests used in psychology and pedagogy (2007).

2. The students are able to use empirical results to calculate selected reliability coefficients, a standard error of measurement and other selected errors of measurement.

3. The students are able to use a standard error of measurement to build a confidence interval of a person’s true score.

4. The students are able to interpret measures calculated or provided (e.g. in test manuals): reliability measures, discriminatory power coefficients and standard error of measurement.

5. The students are able to select appropriate methods to verify a reliability and validity of a test.

6. The students are able to interpret results of a factor analysis and of a principal components analysis.

Competences

1. The students recognize a potential of psychological tests, but remains sensitive to their limitations.

2. The students remain cautious in assessing the psychometric properties of psychological tests.

3. The students are aware of the importance of reliability and validity of measurement for building the correct diagnosis.

4. The students actively protect tests from individuals and institutions that are not authorized to use them.

ECTS:

Lectures - 30 hours

Practical classes - 30 hours

Students’ preparations for the lectures - 15 hours

Students’ preparations for the practical classes – 15 hours

Students’ preparation for the assessment test – 30 hours

TOTAL – 120 hours [120 : 30 = 4]

ECTS points = 4

Practical classes – assessment of Students’ knowledge, skills and competences is based on the written test at the end of semester 1. The detailed scope of the tests and the assessment criteria are specified in the syllabus for the practical classes. In the semester 2 the final grade is the effect of presentations prepared by students, an essay, and activity during classes.

Lectures – at the end of semester 1, the Students’ grade is based on the test completed in the practical classes. The students can receive a higher grade based on the regular and active participation in the lectures. The final written exam is conducted at the end of the second semester. The exam covers the content of the lecture, practical classes and of the recommended (obligatory) literature. The exam verifies the knowledge and skills defined in the learning outcomes. The Students’ competences are subject to verification and assessment as a part of the practical classes..

During the academic year students will be provided with examples of exam questions.

The final written exam can be taken only if a Student completes two semesters of the practical classes successfully (i.e., a positive grade in the practical classes in semester 1 and 2 is a prerequisite for taking the final exam).

Criteria of the exams assessment:

Insufficient (2): A student has mastered less than 60% of knowledge and skills, covered in the teaching program in semester 1 and 2. He or she gives definitions which are incomplete or incorrect. He or she is not able to apply knowledge in practical questions (checking skills).

Sufficient (3): A student has mastered at least 60% of knowledge and skills, covered in the teaching program in semester 1 and 2. He or she is able to demonstrate the knowledge with understanding and is able to apply it in practical tasks / questions.

Good (4): A student has mastered at least 80% of knowledge and skills, covered in the teaching program in semester 1 and 2. He or she is able to demonstrate the knowledge with understanding and is able to apply it in practical tasks / questions.

Very good (5): A student has mastered a virtually whole scope of material, covered in both semesters. He or she can fully and competently present psychometric expertise, and is able to apply it in practical tasks / questions. A student is also able to approach psychometric issues critically.