No, there's actually a lot more of us than them. The combination of gerrymandering and 2 senators per state gives them far more representation than they should have, then add in non-conservative voters being much less likely to vote and they end up with minority rule. But it's not inevitable - if everyone else voted in the same percentages as they do, they wouldn't have a majority in Congress or be in the White House ever again.
If your solution to a problem is "Everyone should just..." then it's not a solution. Plus it sounds like not only is the controller disconnected, it's designed to not work even if it is connected.