Dunning Krueger Effect is an excellent example of bullshit science and people accepting things that sound right instead of rigorously checking.
Read more here https://www.mcgill.ca/oss/article/critical-thinking/dunning-kruger-effect-probably-not-real
Edit: another source, perhaps more appropriate as a source: https://www.psychologytoday.com/us/blog/how-do-you-know/202012/dunning-kruger-isnt-real
So using the Dunning-Krueger effect to prove how smart you are is an example of the Dunning-Krueger effect?
Well it depends on how you’re using it.
On the surface, if I understand what you’re asking correctly, no. From what I’m understanding of these articles, the dunning Krueger effect never did what it set out to accomplish, but something along the lines of people who don’t know much have a much larger amount of things that they themselves aren’t even aware of not knowing… if that makes sense? I can try to reword later tonight after I finish with work
Your last link pissed me off enough I wrote an entire post on why that study is dog shit.
It sometimes pays off to review the methodology and supplementary materials in papers.
I believe that I may have originally gotten wind of this from a less wrong post IIRC. Pretty interesting stuff. Imagine if we trained an AI on doing science and peer review, and set it loose on the suite of research findings and had it report back all the BS...
Permanently Deleted
This disptoves any statistical anonmaly that suggests the majority of people fall into the "dunninng-kruger effect"; it doesn't disprove the existence of ignorant people who overestimate their understanding or knowledgeable people who understimate their understanding.
Thus OP's question becomes: how do you know if you're one of those people?
You know what you know, and you don't know what you don't know. If you don't know what you don't know, it would follow that you wouldn't understand how much you don't know either.
IMO its a philosophy battle, just for the sake of battle. Assuming ignorance, and striving to learn more, learn from your mistakes, and self assess reign supreme - imo.
That is not quite how that works. The effect can apply to separate fields of knowledge or separate skill sets separately. You might actually know what you are talking about when it comes to e.g. plumbing but only think you do when it comes to e.g. IT systems.
Yeah, one big factor is to not assume that you're an expert because you're good at something else and you "did your own research" on this topic
One of them (Dunning or Kruger, can’t recall) was interviewed on the You Are Not So Smart podcast. Look it up.
You need to actively and continuously seek out negative but constructive feedback. It’s the only way to keep an objective perspective on your capabilities.
Organizations that are actually serious about quality have processes for this. Organizations that are not pretend to have processes for this ;)
If you are wondering where you are on the curve, you likely aren't too bad. Simply recognizing that you may not know everything is a bit step along the curve
It's not a single curve, but a repeating wave. Every "aha!" moment is a peak and every "fuck this" is a dip. Source: learning music production for years.
Permanently Deleted
I’m going to answer the broader topic: “how do I know what mastery I have in a subject area?”
-
Are you able to use parts of a problem in that area to fill in the gaps from experience to find a solution?
-
Are you able to identify why an attempted solution to a problem in that area won’t work, and why?
-
Do people refer to you with difficult questions about that area?
-
Are there areas in that subject you feel don’t make complete sense, that when you ask subject matter experts they deflect (or better, admit they don’t understand it either)?
-
Can you identify problems in that subject area that have not been solved, and can, if not take the time to solve them, identify how you would go about solving them?
Each step here shows an increasing level of mastery in a topic.
-
Post a topic such as this in a discussion forum, then monitor the discussions that follow.
Awareness of the amount of stuff you don't know.
It has been alleged that I am expert in my field. But the amount of relevant stuff I don't know is mindblowing.
The effect seems intuitive, however the dunning Krueger effect has been disproven. It is not an accurate theory.
The basic effect Dunning-Kruger is about is real and apparent everywhere. The specific formulation as stated from that pair may have some errors but throwing away the idea due to poor science isn't smart.
https://www.scientificamerican.com/article/the-dunning-kruger-effect-isnt-what-you-think-it-is/
To establish the Dunning-Kruger effect is an artifact of research design, not human thinking, my colleagues and I showed it can be produced using randomly generated data.
First, we created 1,154 fictional people and randomly assigned them both a test score and a self-assessment ranking compared with their peers.
So, the experiment with completely fake data disproves Dunning-Kruger? How is this science?
Depending on the actual thing you're considering, it's putting the knowledge into practice and having a clear way of evaluating whether you're failing
It’s mostly about knowing your limits of knowledge.
If you don’t know about your limits, you’re probably a newbie of the subject. You don’t grasp how much more there’s to learn. You think you’ve learned almost everything.
If you know about your limits, you probably know a lot about the subject. You have learned a lot, but you understand there’s still much more to learn.
That's the neat part, you don't. It's pseudoscience.
Not quite pseudoscience, there was an effect that they thought they measured. Later more rigorous experiments showed that there was no such effect.
This is exactly what science is supposed to do.
