About AI-Therapy

AI-Therapy creates online fully automated programs using the latest evidence-based treatments, such as cognitive behavioural therapy. The social anxiety program has been tested with a randomized controlled trial. To find out more visit:

These results were generate by Comparing two sets of data on September 26, 2023 at 9:28 PM (UTC).

Results

Data set overview

If you would like to share these results, please use the following link:

https://www.ai-therapy.com/psychology-statistics/results/20230926212806271
Data set namePython Levenshtein Distance
Data set notes(not provided)

Data set statistics

Sample nameNumber of samplesMeanStandard error of the meanStandard deviationMedian
Copilot36014.7533.36163.7660.000
ChatGPT3601.5560.4438.4130.000

Test results

Number of samplesN = 720
Wilcoxon rank-sum
  • W = 110478.500
  • z-score = -6.917
  • Asymptotic significance (2-tailed) p < 0.001
  • Based on a significance level of 0.01, there is a statistically siginificant difference between 'Copilot' and 'ChatGPT'.
  • Effect size r = -0.258
Mann-Whitney
  • U = 45498.500
  • z-score = -8.974
  • Asymptotic significance (2-tailed) p < 0.001
  • Based on a significance level of 0.01, there is a statistically siginificant difference between 'Copilot' and 'ChatGPT'.
  • Effect size r = -0.334

Visualization

The graph above is a bihistogram that allows you to compare the distribution of Copilot (top) with the distribution of ChatGPT (bottom).