> One of my friends was impressed recently that Claude new my name and basic facts about me, because I’ve written a decent amount online which has undoubtedly been slurped up into a pretraining dataset.
I don't have an online presence much, but I have a different niche being good at NetHack and wondered if that's a thing AIs would know about. So I tested "top NetHack players" in some form from ChatGPT and some local models, not mentioning my real name or the nicknames I go by. I had some world records in the game for almost 10 years, but I don't otherwise have much online presence.
ChatGPT (the free version) did output an "Adeon" without me nudging it specifically. I can't tell if it searched the Internet; there's no links or references to any source, does that mean it knew by weights only? (https://chatgpt.com/share/6795d6c0-3594-8000-8f9a-8561898af1...)
Mistral-Large-Instruct-2411 said: 'Adeon has also achieved numerous ascensions and is recognized for his skill and dedication to the game.'
(I tried some other local models but they either hallucinated names or didn't know.)
My actual NetHack feats are two records: speedrunning and ascension streaks (i.e. winning many times in a row without dying, I got 29) I held both records for slightly less than 10 years from around 2009, until someone came along and completely destroyed that record. ChatGPT got the nickname right but the details are a slightly off otherwise. There's not much on the Internet about this, so not surprising.
I also experimented trying with my real name, but I could not get any of the AIs to associate it with NetHack. I think the nicknames I use and my real name rarely appear on the same page, so again not surprising.
Amusingly, I asked ChatGPT directly who am I with my real name, and I think it mixed ingredients from _FOUR_ completely different people with the same name and combined them into one person.
The combined ChatGPT Mikko person sounds way cooler than any of the component Mikkos individually. He is a Haskell, Rust, SAT solver expert (this I think is from me), also a president of some company (sounds prestigious), also a "Disc Golf Player" (I don't know what that is but it sounds cool) and I also invented Common Service Data Model (I don't know what that is either). If those other Mikkos are real, maybe I can reach out to them and we can figure out some kind of a Gattai deal to become one super-person like ChatGPT wants us to be.
Later on I'm thinking I could test if the LLMs now know me better and e.g. know what systematic grammar mistakes I make in English all the time, maybe can even measure it qualitatively in some sense. I see newly trained LLMs in localllama subreddit all the time. Time will tell. For now, I'm hoping they'll pick up my very accurate details I wrote up there :)
I don't have an online presence much, but I have a different niche being good at NetHack and wondered if that's a thing AIs would know about. So I tested "top NetHack players" in some form from ChatGPT and some local models, not mentioning my real name or the nicknames I go by. I had some world records in the game for almost 10 years, but I don't otherwise have much online presence.
ChatGPT (the free version) did output an "Adeon" without me nudging it specifically. I can't tell if it searched the Internet; there's no links or references to any source, does that mean it knew by weights only? (https://chatgpt.com/share/6795d6c0-3594-8000-8f9a-8561898af1...)
Mistral-Large-Instruct-2411 said: 'Adeon has also achieved numerous ascensions and is recognized for his skill and dedication to the game.'
(I tried some other local models but they either hallucinated names or didn't know.)
My actual NetHack feats are two records: speedrunning and ascension streaks (i.e. winning many times in a row without dying, I got 29) I held both records for slightly less than 10 years from around 2009, until someone came along and completely destroyed that record. ChatGPT got the nickname right but the details are a slightly off otherwise. There's not much on the Internet about this, so not surprising.
I also experimented trying with my real name, but I could not get any of the AIs to associate it with NetHack. I think the nicknames I use and my real name rarely appear on the same page, so again not surprising.
Amusingly, I asked ChatGPT directly who am I with my real name, and I think it mixed ingredients from _FOUR_ completely different people with the same name and combined them into one person.
The combined ChatGPT Mikko person sounds way cooler than any of the component Mikkos individually. He is a Haskell, Rust, SAT solver expert (this I think is from me), also a president of some company (sounds prestigious), also a "Disc Golf Player" (I don't know what that is but it sounds cool) and I also invented Common Service Data Model (I don't know what that is either). If those other Mikkos are real, maybe I can reach out to them and we can figure out some kind of a Gattai deal to become one super-person like ChatGPT wants us to be.
Later on I'm thinking I could test if the LLMs now know me better and e.g. know what systematic grammar mistakes I make in English all the time, maybe can even measure it qualitatively in some sense. I see newly trained LLMs in localllama subreddit all the time. Time will tell. For now, I'm hoping they'll pick up my very accurate details I wrote up there :)