About AI-Therapy

AI-Therapy creates online fully automated programs using the latest evidence-based treatments, such as cognitive behavioural therapy. The social anxiety program has been tested with a randomized controlled trial. To find out more visit:

These results were generate by Comparing two sets of data on September 22, 2023 at 2:35 PM (UTC).

Results

Data set overview

If you would like to share these results, please use the following link:

https://www.ai-therapy.com/psychology-statistics/results/20230922143540378
Data set nameCode Correctness - Copilot
Data set notes(not provided)

Data set statistics

Sample nameNumber of samplesMeanStandard error of the meanStandard deviationMedian
Java6000.2450.0180.4300.000
Python6000.3750.0200.4850.000

Test results

Number of samplesN = 1200
Wilcoxon rank-sum
  • W = 336900.000
  • z-score = -3.898
  • Asymptotic significance (2-tailed) p < 0.001
  • Based on a significance level of 0.01, there is a statistically siginificant difference between 'Java' and 'Python'.
  • Effect size r = -0.113
Mann-Whitney
  • U = 156600.000
  • z-score = -4.867
  • Asymptotic significance (2-tailed) p < 0.001
  • Based on a significance level of 0.01, there is a statistically siginificant difference between 'Java' and 'Python'.
  • Effect size r = -0.140

Visualization

The graph above is a bihistogram that allows you to compare the distribution of Java (top) with the distribution of Python (bottom).