> The unrewarded space is massively huge. Within that unrewarded space given how massive it it is, there is actually a very high probability that there is at least several sets of inputs in there that form a grammar and a consistent language with consistent outputs.
I think this is a large logical leap. The unrewarded space may be huge, but it is not large enough that it's almost guaranteed (or even close) that we'll find something that looks like language in there. If we did find something that looked like language, even in the unrewarded space, it would be very surprising, which is why the initial post that inspired this response was so talked about! But we have not.
Given the size of the space and the fact that we already found one word it indicates that the probability is high enough that tons of other things like languages exist in that space.
It's like if I gave you a lottery ticket and you won. The lottery ticket is more likely to be rigged then you actually winning. Or in other words, the fact that we even found a secret word is indicative that there's a lot going on in the unrewarded space.
The word wasn't selected randomly, though, so it doesn't tell us much about the broader unrewarded space. And there's a fair amount of evidence that (1) the tokenization of the word includes a bunch of syllables that correspond to the Latin names of birds, and (2) this same technique doesn't work with other reproduced nonsense text (i.e. using the nonsense text produced when asking about workers working in offices gives you more nature scenes, not offices). This makes it difficult to argue that what is going on here is even a secret vocabulary, let alone a secret language.
I think this is a large logical leap. The unrewarded space may be huge, but it is not large enough that it's almost guaranteed (or even close) that we'll find something that looks like language in there. If we did find something that looked like language, even in the unrewarded space, it would be very surprising, which is why the initial post that inspired this response was so talked about! But we have not.