It felt this way for me for my last Samsung S10. Their android become an unusable mess, bloated to the brink,so I switched it to Lineage. It felt like a different phone.
That phone alone determined me to go for Pixels which allow relocking bootloader with custom roms.
If you use your phone like 99% of people do, it will be completely fine. If you don't do gaming or 4K video editing on your phone, there's no problem. The CPU will even be fine for Instagram face filters for the foreseeable future
I ordered the FP5 after using my OnePlus 3T for nearly 7 years, so I imagine it'll be OK on that front, given I'm switching only due to issues with the USB port and power button.