AI-Therapy | Statistics for Psychologists

About AI-Therapy

AI-Therapy creates online fully automated programs using the latest evidence-based treatments, such as cognitive behavioural therapy. The social anxiety program has been tested with a randomized controlled trial. To find out more visit:

These results were generate by Comparing two sets of data on September 26, 2023 at 9:48 PM (UTC).

Results

Data set overview

If you would like to share these results, please use the following link:

https://www.ai-therapy.com/psychology-statistics/results/20230926214810412

Data set name	Java Test Coverage
Data set notes	(not provided)

Data set statistics

Sample name	Number of samples	Mean	Standard error of the mean	Standard deviation	Median
Copilot	360	57.180	0.668	12.672	61.540
ChatGPT	360	58.791	0.666	12.628	64.290

Test results

Number of samples	N = 720
Wilcoxon rank-sum	W = 122436.000 z-score = -2.632 Asymptotic significance (2-tailed) p = 0.008 Based on a significance level of 0.01, there is a statistically siginificant difference between 'Copilot' and 'ChatGPT'. Effect size r = -0.098
Mann-Whitney	U = 57456.000 z-score = -2.635 Asymptotic significance (2-tailed) p = 0.008 Based on a significance level of 0.01, there is a statistically siginificant difference between 'Copilot' and 'ChatGPT'. Effect size r = -0.098

Visualization

The graph above is a bihistogram that allows you to compare the distribution of Copilot (top) with the distribution of ChatGPT (bottom).