Can confirm, got halfway wrecked in my upper div statistics midterm during COVID. 24 hours, open everything. Even the Internet can't replace real understanding.
Gemma2, the new state of the art, still can get above 45% correct in basic addition, and also can't do better than a two or three basic Google searches. GPT is a NLP tool, and using it to do math would be like using a F-35 to weave lace.
That's true, but usually they get their method right (or close to it) but fail on the simple addition. If you use it to help figure out what steps you need to take, you can then run through substituting the correct numbers in and make some real progress.
I just completed a class on hydrology and water engineering with this method. Got a HD. That either says something about the school or something about GPT. Not sure which.
It certainly says something about my willingness to complete water engineering coursework, I'll admit that.
Probably depends on the math. If it's descrete math, or anything where you have to prove something, having internet access isn't going to help (unless the test has been reused and uploaded). Either you can write a proof or you can't. Looking something up probably can only get your so far.