How to Answer a Probability & Significance Question (AQA A Level Psychology) : Revision Note

Raj Bonsor

Written by: Raj Bonsor

Reviewed by: Claire Neeson

Updated on

How do I answer an AQA A Level Psychology probability & significance question?

  • Probability and significance questions can appear in Papers 1 , 2 and 3, and they assess your ability to:

    • demonstrate knowledge and understanding of using statistical tables to determine significance (AO1)

    • apply knowledge and understanding of scientific ideas, processes, techniques and procedures (AO2)

  • A typical significance question is presented with a scenario or stem (usually a research study) and is designed to test your AO2 skills

    • E.g., is the psychologist’s calculated value significant? With reference to Table 1, explain your answer [3 marks]

Using statistical tables to determine significance

  • After determining the correct statistical test, the psychologist will calculate the data they have collected, which will produce an observed or calculated value

    • This is represented as a test statistic, e.g., U = 40, T = 20

    • You will always be given the calculated/observed value in the exam paper for all the statistical tests except the sign test, as you may have to calculate it yourself

  • You may be asked to work out whether the psychologist's results are significant

    • To find this out, the calculated value must be compared to a critical value

    • You will be provided with a table of critical values in the exam paper, e.g.

Table showing critical Pearson’s r values for different significance levels and degrees of freedom (17-20). Calculated r must meet or exceed critical value.
Table of critical values for the Pearson's r test
  • There are several steps involved in selecting the correct critical value from the table

    • Is the hypothesis directional (one-tailed) or non-directional (two-tailed)?

    • How many participants (N) were in the study? For some statistical tests, this figure is degrees of freedom instead (df)

    • What is the level of significance (the standard is p≤0.05)?

  • Once you have all of this data, you need to find the critical value by looking across the correct row and down the correct column

    • It is ok to highlight or circle the critical value you have chosen on the exam paper

  • To determine whether the psychologist's results are significant or not, you will need to compare the calculated value you have been given with the critical value you have chosen

    • There will always be a sentence under the critical values table that tells you whether the calculated value should be equal to/more than or equal to/less than the critical value for the results to be significant

How to write a statement of significance

  • Once significance is determined, a statement of significance will then be written, which should include:

    • the calculated value and whether it is equal to, more than or less than the critical value

    • whether the result is significant or not at the stated significance level

    • whether the study has a one-tailed or two-tailed hypothesis

    • the number of participants (N) or degrees of freedom (df)

      • E.g., as the calculated value of U (10.5) is less than the critical value (17), the result is significant at a 0.05 significance level for a two-tailed test, where N1 = 10 and N2 = 8

    • You should then include what happens to the null hypothesis

      • If the results are significant, the null hypothesis is rejected and the alternative hypothesis is accepted

      • If the results are not significant, the null hypothesis is accepted and the alternative hypothesis is rejected

        • E.g., this means that we can reject the the null hypothesis and accept the alternative hypothesis

Worked Example

Here is an example of a question using statistical tables to determine significance:

A researcher investigated whether there was a correlation between the number of hours slept and how well rested students felt. The researcher randomly selected 18 participants from first-year students at a university.

On the day of the study, each student participant was asked, ‘How many hours did you sleep last night?’ They then had to rate on a scale of 1 to 5 how well rested they felt.

The researcher hypothesised that there would be a positive correlation between the two covariables.

The researcher chose to use the 5% level of significance and the calculated correlation coefficient for the Spearman’s rho test was 0.395

Level of significance for a one-tailed test

0.05

0.025

Level of significance for a two-tailed test

0.10

0.05

N = 16

0.429

0.503

        17

0.414

0.485

        18

0.401

0.472

        19

0.391

0.460

        20

0.380

0.447

The calculated value of rho must be greater than or equal to the critical value to be significant.

Q1.  Identify the appropriate critical value from the table above. Explain your choice.

[4 marks]

Identify the critical value:

  • the critical value is 0.401 [1 mark]

Provide three justifications:

  • the hypothesis is directional/it is a one-tailed test

  • there are 18 participants so N = 18

  • the level of significance is 0.05 [3 marks]

Marking commentary:

This response receives full marks as the critical value is correctly identified and justified. The hypothesis is directional, as in the stem it states, 'there would be a positive correlation'. The number of participants and the level of significance are also provided in the stem.

Worked Example

Here is an example of a question requiring a statement of significance:

Q2. Explain whether the results are significant. Refer to the critical value identified in Q1 in your answer.

[3 marks]

Model answer: 

  • As the calculated value of rho (0.395) is less than the critical value (0.401), the result is not significant at a 0.05 significance level for a one-tailed test, where N = 18. This means that we can accept the the null hypothesis and reject the alternative hypothesis [3 marks]

Marking commentary:

This response receives full marks as the results are not significant as the calculated value of rho provided in the stem (0.395) is less than the critical value. The sentence below the critical values table states that 'the calculated value of rho must be greater than or equal to the critical value to be significant'.

Examiner Tips and Tricks

Examiners have suggested the following advice to help you improve your performance on probability and significance questions:

  • Read the stem carefully and focus on the specific wording used

  • Read the stem more than once, as there is usually a lot of information provided about the research study

  • It is helpful to highlight, underline and annotate parts of the stem/research study before you answer any questions

    • This will help you to fully engage with and understand the study

  • Highlight, circle or underline the chosen critical value in the table, as you can still earn a mark if you forget to include the value in your answer

  • In case you are not given a probability/significance value, remember that the usual level in psychology is 0.05

  • Remember that the only test that you need to calculate is the sign test

You've read 0 of your 5 free revision notes this week

Sign up now. It’s free!

Join the 100,000+ Students that ❤️ Save My Exams

the (exam) results speak for themselves:

Did this page help you?

Raj Bonsor

Author: Raj Bonsor

Expertise: Psychology & Sociology Content Creator

Raj joined Save My Exams in 2024 as a Senior Content Creator for Psychology & Sociology. Prior to this, she spent fifteen years in the classroom, teaching hundreds of GCSE and A Level students. She has experience as Subject Leader for Psychology and Sociology, and her favourite topics to teach are research methods (especially inferential statistics!) and attachment. She has also successfully taught a number of Level 3 subjects, including criminology, health & social care, and citizenship.

Claire Neeson

Reviewer: Claire Neeson

Expertise: Psychology Content Creator

Claire has been teaching for 34 years, in the UK and overseas. She has taught GCSE, A-level and IB Psychology which has been a lot of fun and extremely exhausting! Claire is now a freelance Psychology teacher and content creator, producing textbooks, revision notes and (hopefully) exciting and interactive teaching materials for use in the classroom and for exam prep. Her passion (apart from Psychology of course) is roller skating and when she is not working (or watching 'Coronation Street') she can be found busting some impressive moves on her local roller rink.