Skip navigation

Category Archives: Programming

Source: Scientists find ChatGPT is inaccurate when answering computer programming questions

The paper referenced: https://dl.acm.org/doi/10.1145/3613904.3642596

This is a real indictment of SO (well known among programmers):  

Another concern is the presence of toxicity and negative sentiment in people’s answers and comments on Stack Overflow. Calefato et al. [19] found that the presence of positive and negative sentiment contributes towards the upvotes and downvotes of SO answers respectively. In a follow-up study, they found that novices and student programmers often encounter arrogant and rude comments on Stack Overflow, which discourages them from posting questions [20]. Asaduzzaman et al. [4] also found that the presence of toxicity and negative emotions in SO answers can discourage follow-up discussions on Stack Overflow. Our study also confirms this, since users prefer ChatGPT answers due to their politeness and positive sentiment.