About AI-Therapy

AI-Therapy creates online fully automated programs using the latest evidence-based treatments, such as cognitive behavioural therapy. The social anxiety program has been tested with a randomized controlled trial. To find out more visit:

These results were generate by ANOVA on November 11, 2023 at 10:37 AM (UTC).

Data set overview

If you would like to share these results, please use the following link:

https://www.ai-therapy.com/psychology-statistics/results/20231111103705019
Data set nameChatGPT Test Correctness
Data set notesPython

Data set statistics

Sample nameNumber of samplesMeanStandard deviationStandard error of the meanMedian
AIGenerated1200.6670.4730.0431.000
BookExampleCode1200.7500.4350.0401.000
PromptOnly1200.7250.4480.0411.000

Test summary

Test nameKruskal–Wallis one-way ANOVA
Total number of samplesN = 360
Groups
  • AIGenerated: Count =120, Mean rank=172.000
  • BookExampleCode: Count =120, Mean rank=187.000
  • PromptOnly: Count =120, Mean rank=182.500
Test statisticH(2) = 2.143
Statistical significance (Two-tailed)p = 0.343
ConclusionBased on a p-value threshold of 0.05, there is not a statistically siginificant difference between: {AIGenerated,BookExampleCode,PromptOnly}.