AI-Therapy | Statistics for Psychologists

About AI-Therapy

AI-Therapy creates online fully automated programs using the latest evidence-based treatments, such as cognitive behavioural therapy. The social anxiety program has been tested with a randomized controlled trial. To find out more visit:

These results were generate by Comparing two sets of data on November 11, 2023 at 10:25 AM (UTC).

Results

Data set overview

If you would like to share these results, please use the following link:

https://www.ai-therapy.com/psychology-statistics/results/20231111102532634

Data set name	Code Correctness - ChatGPT
Data set notes	(not provided)

Data set statistics

Sample name	Number of samples	Mean	Standard error of the mean	Standard deviation	Median
Java	600	0.107	0.013	0.309	0.000
Python	600	0.208	0.017	0.406	0.000

Test results

Number of samples	N = 1200
Wilcoxon rank-sum	W = 342000.000 z-score = -3.049 Asymptotic significance (2-tailed) p = 0.002 Based on a significance level of 0.01, there is a statistically siginificant difference between 'Java' and 'Python'. Effect size r = -0.088
Mann-Whitney	U = 161700.000 z-score = -4.832 Asymptotic significance (2-tailed) p < 0.001 Based on a significance level of 0.01, there is a statistically siginificant difference between 'Java' and 'Python'. Effect size r = -0.139

Visualization

The graph above is a bihistogram that allows you to compare the distribution of Java (top) with the distribution of Python (bottom).