Annex 5 - Pilot 1: Statistical Analysis of SAT Answers

• Author: Castaño, Jonatan; Centeno, Clara; Jakobsone, Mara; Kluzer, Stefano; Troia, Sandra; Vuorikari, Riina; Cabrera, Marcelino; O'Keeffe, William; Zandbergs, Uldis; Clifford, Ian; Punie, Yves
• Pages: 63-90

DigCompSAT: A Self-reflection Tool for DigComp

63

Annex 5 - Pilot 1: Statistical Analysis of SAT Answers

5.1 Detailed analysis of time spent and test scores

Time spent on test

The time spent on the SAT during the first pilot was measured for the whole SAT. The Moodle platform allowed

to complete th e whole SAT in one sitting, but it also allowed to take breaks. Because of this possibility, there

were 10 attempts regi stered as being 4 hours or longer. It was deemed unrealistic that SAT would take such a

long time. Therefore, those attempts were set at the 111 minutes which was the longest time that was just

possible in one sitting.

The average time spent on the SAT by 144 participants was thus calculated to be 35 minutes with the minimum

of 12 minutes and the maximum of 111 minutes and the stan dard deviation of 24.730. The time spent on the

test includes all 107 items of the SAT.

Further on analysis of time spent on SAT by different groups of participants is presented.

Time by Gender

The participants (N=144) were divided in two groups:

— 1 – female (N=81),

— 2 – male (N=63).

The mean value of time spent on SAT by both genders was 35 minutes with only slight variation in range a nd

standard deviation of values. It can be concluded that both groups will have spent similar time on S AT.

Table 5.1 Time by Gender

Time by Gender

Cases

Included

Excluded

Total

N

Percent

N

Percent

N

Percent

Time * Gender

144

100,0%

0

0,0%

144

100,0%

Report – Time

Gender

Mean

Minimum

Maximum

N

Std. Deviation

Female

35

15

111

81

24,297

Male

35

12

111

63

25,470

Total

35

12

111

144

24,730

DigCompSAT: A Self-reflection Tool for DigComp

64

Time by Age Group

Participants (N=144) were divided in 3 age groups:

— 1 – 16-24 years old (N=35),

— 2 – 25-54 years old (N=88),

— 3 – 55-65 years old (N=21).

The mean value of the time spent on SAT by three age groups was 29 minutes for younger age group and 36

and 39 minutes for two older age groups. The difference is not big., but it can be expected that younger

participants will finish the SAT in shorter time than others.

Table 5.2 Time by Age Group

Time by Age

Group

Cases

Included

Excluded

Total

N

Percent

N

Percent

N

Percent

Time * Age

144

100,0%

0

0,0%

144

100,0%

Report – Time

Age

Mean

Minimum

Maximum

N

Std. Deviation

16-24 years

29

13

111

35

16,851

25-54 years

36

12

111

88

25,537

55-65 years

39

12

111

21

31,187

Total

35

12

111

144

24,730

Time by Education Level

Participants (N=144) were divided in 3 groups based on their education level:

— 1 – low (N=5),

— 2 – medium (N=66),

— 3 – high (N=73).

The mean value of low education group is noticeably higher at 60 minutes, but the number of participants

from this groups is very small (N=5) so it may not represent the group very well. It would benefit the next pilot

phase to gather more data for this group. The mean value of time spent on SAT by medium education group

was 31 and by higher education group was 37 minutes.

It is suspected that younger age groups have not yet been able to reach higher education levels and the results

divided by the age groups are related to results divided by education level groups.

Table 5.3 Time by Education Level

Time by Education

Level

Cases

Included

Excluded

Total

N

Percent

N

Percent

N

Percent