Brainee Posted October 7, 2023 Share Posted October 7, 2023 Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics. Link to comment Share on other sites More sharing options...
exchemist Posted October 7, 2023 Share Posted October 7, 2023 (edited) 5 minutes ago, Brainee said: Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics. You're a mug then, because it isn't. We've already had some threads discussing how unreliable it is for mathematical science. Edited October 7, 2023 by exchemist Link to comment Share on other sites More sharing options...
swansont Posted October 7, 2023 Share Posted October 7, 2023 3 hours ago, Brainee said: Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics. Why would you use a language model for science or math? Link to comment Share on other sites More sharing options...
Endy0816 Posted October 8, 2023 Share Posted October 8, 2023 10 hours ago, Brainee said: Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics. It'll write something that sounds believable, but may not be correct. I do think it can give useful insight into a subject. Link to comment Share on other sites More sharing options...
Brainee Posted October 9, 2023 Author Share Posted October 9, 2023 On 10/7/2023 at 11:52 PM, swansont said: Why would you use a language model for science or math? On 10/7/2023 at 8:50 PM, exchemist said: You're a mug then, because it isn't. We've already had some threads discussing how unreliable it is for mathematical science. I have used it and it has given what appears to be correct. It gives same answer as Google search. Link to comment Share on other sites More sharing options...
exchemist Posted October 9, 2023 Share Posted October 9, 2023 (edited) 58 minutes ago, Brainee said: I have used it and it has given what appears to be correct. It gives same answer as Google search. Sure, it might sometimes, but others on this forum have found instances where it is wrong or nonsensical. As @studiot says, it is language model. As such it is not well adapted for mathematical science. You asked if it is reliable, and the answer is evidently no it isn't. Edited October 9, 2023 by exchemist Link to comment Share on other sites More sharing options...
studiot Posted October 9, 2023 Share Posted October 9, 2023 54 minutes ago, exchemist said: Sure, it might sometimes, but others on this forum have found instances where it is wrong or nonsensical. As @studiot says, it is language model. As such it is not well adapted for mathematical science. You asked if it is reliable, and the answer is evidently no it isn't. Thanks and I agree that CHATGPT is a language model. How many know what that means ? However I think @swansont deserves the credit for the quote here. Link to comment Share on other sites More sharing options...
swansont Posted October 9, 2023 Share Posted October 9, 2023 It’s not hard to find examples of ChatGPT giving wrong math/science answers. GPT stands for Generative Pre-trained Transformer, which is, as I said, a language model. ChatGPT is designed to generate answers that sound human. https://finance.yahoo.com/news/over-just-few-months-chatgpt-232905189.html “Over the course of the study researchers found that in March GPT-4 was able to correctly identify that the number 17077 is a prime number 97.6% of the times it was asked. But just three months later, its accuracy plummeted a lowly 2.4%.” https://news.asu.edu/20230221-discoveries-do-math-chatgpt-sometimes-cant-expert-says “Our initial tests on ChatGPT, done in early January, indicate that performance is significantly below the 60% accuracy for state-of-the-art algorithm for math word problem-solvers,” Also “It’s designed around a concept called next word prediction, where for when you ask it something, it’s going to predict what the related words are based on a corpus (text and speech) data.” 1 Link to comment Share on other sites More sharing options...
studiot Posted October 9, 2023 Share Posted October 9, 2023 I posted this excerpt from ellenberg whcih explains the essence of language models. Link to comment Share on other sites More sharing options...
iNow Posted October 9, 2023 Share Posted October 9, 2023 It depends on the dataset used to train the model and how the question is asked Link to comment Share on other sites More sharing options...
exchemist Posted October 10, 2023 Share Posted October 10, 2023 13 hours ago, studiot said: Thanks and I agree that CHATGPT is a language model. How many know what that means ? However I think @swansont deserves the credit for the quote here. Oops, sorry and sorry to @swansont - I must be getting senile. 😄 Link to comment Share on other sites More sharing options...
Brainee Posted October 10, 2023 Author Share Posted October 10, 2023 What is a suitable search engine for science and mathematics? Link to comment Share on other sites More sharing options...
swansont Posted October 10, 2023 Share Posted October 10, 2023 Wolfram alpha can do computations, including topic-specific applications https://www.wolframalpha.com Link to comment Share on other sites More sharing options...
Brainee Posted October 11, 2023 Author Share Posted October 11, 2023 I would like site which explains science and mathematics not one that does computations for you. Link to comment Share on other sites More sharing options...
iNow Posted October 11, 2023 Share Posted October 11, 2023 They’re called universities Link to comment Share on other sites More sharing options...
CharonY Posted October 11, 2023 Share Posted October 11, 2023 Or for starters, books. Link to comment Share on other sites More sharing options...
Endy0816 Posted October 11, 2023 Share Posted October 11, 2023 Kahn Academy is good. https://www.khanacademy.org/ Covers a wide range. Link to comment Share on other sites More sharing options...
iNow Posted November 30, 2023 Share Posted November 30, 2023 On 10/9/2023 at 5:19 PM, studiot said: I posted this excerpt from ellenberg whcih explains the essence of language models. You might enjoy this if you’ve got an hour free: Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now