No, weights are not just data fed but also the training process itself. I think the whole argument hinges on how much human thought and action is needed in training the model.

On the other end of the spectrum, AI generated content couldn't be copyrighted if there is no human involvement. If someone asks GPT to write 1000 poems, it couldn't be copyrighted.