A prominent open-source dev publishes their findings as to what's going on with Starfield's performance, and it's pretty darn strange.
According to Hans-Kristian Arntzen, a prominent open-source developer working on Vkd3d, a DirectX 12 to Vulkan translation layer, Starfield is not interacting properly with graphics card drivers.
I've had not a single crash so far and most of my frame dipping issues (from 60 to 40) were solved by lowering the shadows to medium. The only bugs I had were ships spawning in other ships so they spaz out, but that's very rare. On the other hand, Baldurs Gate 3 would constantly drop to 10 FPS and I had severe bugs that locked me out of entire questlines.
But I guess I'm not allowed to enjoy games and have fun because gamebryo = bad