25/08/2023
1. FEATURES
🟢 ChatGPT+:
- Plugins
- Code Interpreter
- Custom Instructions
🟤 Claude:
- Completely free
- Context window is 100k
- It can read files free
I consider this a TIE since these are more a personal preference.
2. CREATIVE THINKING/LANGUAGE
Prompt: “Write a 4-line poem where each line has 3 words only”
ChatGPT+: âś…
Claude: ❌
3. UP-TO-DATE
Prompt: “Who is the CEO of Twitter?”
Both of them got it incorrectly but Claude seems more up to date.
Also, when you ask to: “Write about [x] providing citations and links”, Claude usually provides better and more updated results.
ChatGPT+: ❌
Claude: âś…
4. MATH/LOGIC
Prompt: “If you choose an answer to this question at random, what is the chance you will be correct?
- A) 25%
- B) 50%
- C) 60%
- D) 25%”
ChatGPT+: âś…
Claude: ❌
5. MATH WITH PRIME NUMBERS
Prompt: “Is 10631 a prime number?”
ChatGPT doesn’t like too much Prime numbers, I tested a couple of variations and find problems as well.
ChatGPT+: ❌
Claude: âś…
6. CODING
They were both pretty good and after awhile, I was able to make one of them miss.
Prompt: “In Python, find the first two numbers missing in an ordered list of numbers. For example, in [3,4,5,7,8,10,12], the output would give 6 and 9.”
ChatGPT+: âś…
Claude: ❌
7. REASONING
Prompt: “There are two men. One of them is wearing a red shirt, and the other is wearing a blue shirt.
The two men are named Andrew and Bob, but we do not know which is Andrew and which is Bob.
The guy in the blue shirt says, 'I am Andrew’. The guy in the red shirt says, 'I am Bob.' If we know that at least one of them lied, then what color shirt is Andrew wearing?”
ChatGPT+: âś…
Claude: ❌
RESULTS
🟢 ChatGPT+: 5
🟤 Claude: 3
Counting 32 questions both got correct:
🟢 ChatGPT+: 37
🟤 Claude: 35