This is why GPU Drivers Might Not Matter [Hardware Canucks]
This is a great look at a number of games over time from launch to months after launch benchmarking the patch releases as well as drivers. The end conclusion is the day 1 drivers that Nvidia/AMD/Intel produce are worth having and they improve performance and fix bugs but later drivers don't show as helping and the performance changes after that point are attributable to the game updates.
What is wild is Baldur's Gate loosing a tonne of performance in a patch and has never recover its prior performance and it can't utilise the GPU at all well now but there are other games showing not just increases but degradation of performance as well.
For the average windows office or windows doom gamer? No. For anyone else? Definitely yes. Especially Intel GPUs and NVidia with Linux need massive updates to improve.
I mean, if GPUs launch with perfectly optimized drivers then driver UPDATES don't matter, but drivers literally translate foreign nonsensical (to the GPU) shader code into instructions the GPU understands. Without them, your GPU is as useful as a brick. The driver situation is not there yet especially for NVIDIA GPUs. There's a reason I run mesa-git, driver improvements absolutely do matter.