in fairness.. this is more a limitation of the current technology. your look at gpt4 and going not an expert. but what about gpt5 or 6.. or some of the newer ideas like microsoft plan for 1 million token model using attention dialation mechnism. The point being we are still on the ground floor. And these models have emgerent functionality