Yeah, pretty much (GPT-4's a big upgrade over the default 3.5).
That said, OpenAssistant is already really impressive for a project with such limited resources. Would love to see open-source overtake OpenAI quickly (which IMO isn't out of the question, considering how quickly Stable Diffusion developed)