{"id":1258,"date":"2024-05-30T13:55:40","date_gmt":"2024-05-30T17:55:40","guid":{"rendered":"https:\/\/www.carloswsmith.com\/blog\/?p=1258"},"modified":"2024-05-30T14:00:44","modified_gmt":"2024-05-30T18:00:44","slug":"scientists-find-chatgpt-is-inaccurate-when-answering-computer-programming-questions","status":"publish","type":"post","link":"https:\/\/www.carloswsmith.com\/blog\/?p=1258","title":{"rendered":"Scientists find ChatGPT is inaccurate when answering computer programming questions"},"content":{"rendered":"<p>Source: <em><a href=\"https:\/\/techxplore.com\/news\/2024-05-scientists-chatgpt-inaccurate.html\">Scientists find ChatGPT is inaccurate when answering computer programming questions<\/a><\/em><\/p>\n\n\n<p class=\"wp-block-paragraph\">The paper referenced: <a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3642596\">https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3642596<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is a real indictment of SO (well known among programmers): \u00a0<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Another concern is the presence of toxicity and negative sentiment in people\u2019s answers and comments on Stack Overflow. Calefato et al.\u00a0[<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3642596#BibPLXBIB0019\">19<\/a>] found that the presence of positive and negative sentiment contributes towards the upvotes and downvotes of SO answers respectively. In a follow-up study, they found that novices and student programmers often encounter arrogant and rude comments on Stack Overflow, which discourages them from posting questions\u00a0[<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3642596#BibPLXBIB0020\">20<\/a>]. Asaduzzaman et al.\u00a0[<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3642596#BibPLXBIB0004\">4<\/a>] also found that the presence of toxicity and negative emotions in SO answers can discourage follow-up discussions on Stack Overflow. Our study also confirms this, since users prefer ChatGPT answers due to their politeness and positive sentiment.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Source: Scientists find ChatGPT is inaccurate when answering computer programming questions The paper referenced: https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3642596 This is a real indictment of SO (well known among programmers): \u00a0 Another concern is the presence of toxicity and negative sentiment in people\u2019s answers and comments on Stack Overflow. Calefato et al.\u00a0[19] found that the presence of positive and [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7,78,22],"tags":[],"class_list":["post-1258","post","type-post","status-publish","format-standard","hentry","category-ai","category-programming","category-risks"],"_links":{"self":[{"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1258","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1258"}],"version-history":[{"count":3,"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1258\/revisions"}],"predecessor-version":[{"id":1261,"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1258\/revisions\/1261"}],"wp:attachment":[{"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1258"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1258"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.carloswsmith.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1258"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}