tbf vscode is a decent, open-source editor with great support for Rust (it's rust-analyzer's primary platform with nvim and Clion on the second place)
(but the official ms packages ship with a custom config with ms telemetry, branding and marketplace)
basically just use code(oss) or vscodium instead of binary vscode releases
Most of the language servers can run with Vim, Neovim, Helix, Kakoune, or Emacs as you noted. You could run VS Codium if you’re the “Tech Conservative”, but ultimately if you’re going all the way to “Tech Paranoid”, you won’t touch VS Code or Codium knowing Microsoft is steering the ship with another EEE plot in mind. It’s all a part of that package with Microsoft™ GitHub® + Codespaces® + Copilot® trying to vendor lock-in the developer experience into the platform.
It's "open source" as a technical matter, but the fact is that plenty of common extensions are still strictly controlled by Microsoft (like say, Live Share) and can't be used with vscodium due to licensing. It's a pretty useless editor without extensions, and the marketplace isn't exactly "open", either.