Birth of machine learning algorithm that digitizes 'understandability' from brain scan data


By

yarruta

Studying is important, but in most cases it is necessary to take a test to find out the degree of understanding that can be said to be the result. Meanwhile, a collaborative research team of psychologists and engineers at Dartmouth University has developed a machine learning algorithm that measures understanding from brain scan data.

Decoding individual differences in STEM learning from functional MRI data | Nature Communications
https://www.nature.com/articles/s41467-019-10053-y

Your Brain Activity Can Be Used to Measure How Well You Understand a Concept Untitled
https://www.dartmouth.edu/press-releases/measuring_concept_knowledge_through_brain_activity.html

In order to find out what is happening in the brain of a person who has a deep understanding of the problem, the research team is a student who is an engineering / physics specialty who belongs to Dartmouth University as a subject. ) And 'engineering and physics are not specialized' students (following, beginners) were gathered a total of 28 people. Advanced students are students who have taken at least one course in mechanical engineering course and one in advanced physics course, and beginners are students who have not taken engineering / physics course since entering the university.

The research team conducted engineering and physics tests with conventional paper and pen tests. The average score for beginners is 16.9 for mechanical engineering and 35.9 for physics, while the average score for advanced experts is 50.9 points for mechanical engineering and 79.3 points for physics.・ It was confirmed that there is a difference in knowledge in the field of physics.


By

bialasiewicz

The next experiment was to scan brain activity with fMRI while testing for the law of action and reaction. The test is to look at photos of water towers, bridges, lights, etc. and to consider the external force that the object is receiving.

An example of the problem is the image below. The same water tower appears in the two images on the left and right, but the arrows that indicate the external force that the water tower is receiving are different. The arrows drawn on the water tower on the left represent the external forces correctly, but the right side contains a mistake. The subjects were required to find out in a short time whether the picture was 'correct' or 'incorrect'. As a result of conducting the test, the average correct answer rate of the seniors was 75%, and the beginners were 53.6%.



According to the scan results during the test obtained from fMRI, it is found that the advanced and the beginner activate different brain sites during the test. The following image is a visualization of it. The red area is the site activated by the expert during the test, and the light blue area is the site activated by the beginner during the test. Areas where both advanced and beginners were activated are shown in blue.



As a result of the research, it was found that the seniors unconsciously judge that 'the force is applied obliquely' and 'this is the force only in the vertical direction' when the photograph of the object is shown. Furthermore, it turned out that the parts of the brain activated according to the unconscious judgment result are similar among the advanced users. From the experimental results obtained, the research team seems to have developed a machine learning algorithm that quantifies the 'degree of understanding' according to the activation site of the brain. According to the research team, the higher the 'understood' calculated by the machine learning algorithm, the higher the subject's test score.

The research may be used in the future to find out the best learning method among different learning methods. In addition, the research team is currently conducting comparative experiments on whether 'practice in the real world' or 'learning in a virtual space' is the best learning method.

in Science, Posted by darkhorse_log