X11 came out in 1987. Windows 1.0 came out in 1985. Not sure why that is relevant or represents some kind of point since a lot of windowing UIs were emerging around the same time.
It didn't come out in 1984. And that's without pointing out that X11 is a protocol, not a window manager. I.e. it rendered stuff in a box but didn't say what to do other than that. It took the likes of xt and window managers et al to place some semblance of widgets on apps and they were still a disconnected mess. The first time X became a "desktop" were things like Solaris, XDE, CDE etc. It was still disjointed dogshit compared to Windows, MacOS, AmigaOS, GEM, RISC OS, OS2 etc. The first time that something approached being a modern desktop was with GNOME and KDE but even those spent a long time getting anywhere close to usable. E.g. GNOME sucked untl GNOME red carpet / later ximian was the first pretty good Linux desktop.