1. programming learning support system

In the field of information science (and not only in the field of information science), programming is often used as a tool to solve certain problems. Universities and other educational institutions offer programming classes to help students learn the skills and abilities to effectively program for problem solving in the future. Some university undergraduates who are new to programming may not be able to visualize the behavior of the program presented by the teacher. Visualization of program behavior is an effective method to help them understand the behavior of programs. In fact, there are many tools for program behavior visualization. However, in many cases, these tools can only visualize the rules determined by the system developer. However, in the field of actual programming learning, there is a reality that the visualization method varies depending on what the teacher wants to teach, even for the same program. Therefore, we have developed TEDViT, a programming behavior visualization system that allows the teacher to instruct the visualization method. Currently, we are examining whether the same framework can be used for subjects other than programming in which “some procedures are visualized and explained” based on TEDViT. Currently, we are applying TEDViT to complex arithmetic in mathematics, numerical operations such as Newton’s method, and simplification of logical expressions.

Program behavior visualization system TEDViT

2. Second language learning support system

In second language learning, a communicative approach (CA) is often used, in which the language is learned through communication between the “teacher” and the “learner”. In CA, the approach is to point out mistakes in retrospect. In contrast to CA, there is a method called Focus on Form (FoF), which is based on CA, but in which the teacher is in the instructional mode and gives focus to the language form that the teacher has set during the dialogue. In our laboratory, we have developed a Japanese language learning support system based on FoF and a learning environment experience system called Dictogloss. In these studies, language learning is conducted through role-playing, which is often used to experience expressions in language learning, in which the learner takes on the role of a character (role) in a set situation and actually inputs dialogue within a predetermined range. In this research, error judgment of the learner’s input is performed based on the assumption that “the learner may input incorrect Japanese. The computer interacts with the learner, which is called a “cooperative learner agent (CLA)” that intentionally makes mistakes in the linguistic forms and keywords that it wants the learner to focus on, according to the learner’s correctness or incorrectness. Thus, in this research, we are constructing a “role-playing type learning support system in which the learner plays a role in a situation set by the teacher.

3. Language learning support system for speaking skills

To learn the four skills of second language learning (reading, writing, listening, and speaking), a keyboard and display are not enough. A speaker is sufficient for listening, but a microphone is necessary for speaking, which raises the problem of how to handle the input speech. Currently, it is almost impossible to recognize spoken speech with 100% accuracy. Furthermore, in second language learning, the learner is still learning the language and may not be able to pronounce the input correctly in the first place. We have developed a pronunciation evaluation system that can recognize incorrect pronunciations of words in speech by adding the most error-prone pronunciations to a speech recognition dictionary in advance. We have also developed a system that can also evaluate word accents. In addition to pronunciation and accent evaluation for second language learning support, we are currently studying a framework for intonation evaluation of entire sentences. We are also investigating ways to use voice in the field of programming learning.

Collaborative Research

I also conduct joint research with several professors on 1) programming learning support and 2) second language learning support (see the web page of the joint laboratory here).