Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
saliagato
on May 13, 2024
|
parent
|
context
|
favorite
| on:
GPT-4o
gpt-4 was indeed trained on gpt-3 instruct series (davinci, specifically). gpt-4 was never a newly trained model
whimsicalism
on May 13, 2024
[–]
what are you talking about? you are wrong, for the record
fooker
on May 13, 2024
|
parent
[–]
They have pretty much admitted that GPT4 is a bunch of 3.5s in a trenchcoat.
whimsicalism
on May 13, 2024
|
root
|
parent
[–]
They have not. You probably read "MoE" and some pop article about what that means without having any clue.
matsemann
on May 13, 2024
|
root
|
parent
[–]
If you know better it would be nice of you to provide the correct information, and not just refute things.
whimsicalism
on May 13, 2024
|
root
|
parent
[–]
gpt-4 is a sparse MoE model with ~1.2T params. this is all public knowledge and immediately precludes the two previous commentators assertions
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
