糖心视频

Project implementation plan

We will introduce the implementation plan for the Next Generation Well-Being - Building integrated human measurement and modeling technology aimed at individual adaptation - project.

FY2016

the goal

Implementation Plan

[Biometrics Group]:
We will investigate social needs in the fields of health and welfare, knowledge education, and skills training. We will also use existing devices to measure biosignals emitted by humans, and examine the technical specifications to see to what extent information that meets social needs can be inferred using conventional signal processing and analysis techniques.

[Motion Measurement G]:
We will consider the specifications for a sensor with sufficient sensitivity and dynamics to measure the movements to be measured, as well as the structure of a new sensing device.

[Modeling G]:
As a basic experiment to meet social needs, we will conduct physiological measurements for a simple synchronization task, analyze central nervous system indicators, autonomic nervous system indicators, and physical movement indicators, and model causal relationships.

[Individual Compatibility G]:
We will conduct basic experiments using haptic devices regarding the intersensory interactions between vision, hearing, and touch, which have not been much studied to date, and examine to what extent they can meet social needs from the perspective of sensory perception psychology.

[Evaluation criteria for the achievement of plans and goals]
The shortcomings of existing hardware and software technologies in relation to the specifications extracted from societal needs have been clarified, and the specifications for the elemental technologies that need to be researched and developed in this project to resolve those shortcomings have been clarified.

FY2017

the goal

Implementation Plan

[Biometrics Group]:
As prototypes, we will improve each device and design new devices. Furthermore, we will consider methods to improve the accuracy and versatility of processing and analysis technology. In addition, we will use a newly purchased electroencephalograph to clarify the relationship between changes in the brain, which are the true values of emotions, and indirect changes in physiological indicators.

[Motion Measurement G]:
We will develop a prototype measuring device and use a newly purchased hyperspectral camera to elucidate the mechanisms of visual characteristics and conduct demonstration experiments. Furthermore, we will improve the prototype as necessary.

[Modeling G]:
Based on a causal model for a simple synchronization task, we will construct a biofeedback system based on autonomic nervous system indicators such as hemodynamics from central nervous system indicators such as electroencephalograms and cerebral blood flow measured using newly purchased equipment, and conduct basic studies on constructing an individually adapted model by verifying the effectiveness of suppressing a decrease in wakefulness.

[Individual Compatibility G]:
We will conduct basic research into technology that can present individually tailored services to target users, and by combining a 3D video display with a haptic device and audio playback equipment, we will clarify the interactions between vision, touch and hearing in a multimodal environment.

[Evaluation criteria for the achievement of plans and goals]
A prototype that meets the specifications of the core technologies to be developed in this project has been constructed, and experimental plans for measuring data in the fields of health and welfare, knowledge education, and skills training have been clearly defined.

FY2018

the goal

Implementation Plan

[Measurement Section]:
As a measurement division, we will determine the specifications of the measurement device as hardware to integrate the prototype technologies of the biomeasurement group and the movement measurement group. Furthermore, we will study signal processing algorithms that are robust against noise, optimal individual feature values as the characteristics of subjects, and state estimation methods, not only from the viewpoint of hardware but also from the viewpoint of software. Furthermore, to confirm the effectiveness, we will collect large amounts of data in three contexts, the fields of health and welfare, knowledge education, and skills training, and build a database.

[Individual Eligibility Category]:
In the Individual Adaptation Division, the results of the Modeling Group and the Individual Adaptation Group will be integrated to carry out physiological measurements of more complex tasks. Furthermore, central nervous system indexes, autonomic nervous system indexes, and physical movement indexes will be analyzed, and by modeling causal relationships, common models and individual adaptation parameters in the individual adaptation model will be examined. Furthermore, with the aim of improving the reality of virtual spaces in Virtual Reality, a rendering method will be examined that takes into account the impact of user interaction on the virtual space.

[Evaluation criteria for the achievement of plans and goals]
The device must be developed and introduced, and a database must be constructed. In addition, the mechanisms of the common model and individual adaptation parameters in the individual adaptation model must be elucidated based on the constructed database.

2019

the goal

Implementation Plan

[Measurement Section]:
The system that combines the unrestrained and wearable measurement technologies that we have developed will be subjected to field experiments in three real-world environments in Japan and overseas: health and welfare, knowledge education, and skills training, to verify the effectiveness of the bio-measurement and movement measurement technologies. In addition, we will develop technology that can estimate the subject's condition with high accuracy using the bio-big data accumulated in the database.

[Individual Eligibility Category]:
We will develop a biofeedback system based on central and autonomic nervous system indicators and verify the effects of common models and individual adaptation parameters in the fields of health and welfare, knowledge education, and skill training. We will also develop a multimodal stimulation presentation device that combines an optimal combination of a video display, a haptic device, and an audio signal generation device.

[Evaluation criteria for the achievement of plans and goals]
A database-based technology for estimating the state of the subject has been established, and a multimodal stimulus presentation device has been constructed. In addition, field experiments have been carried out both in Japan and overseas, feedback has been obtained from users in the field, and shortcomings in the technical specifications and solutions have been clarified in the measurement and individual adaptation departments.

Reiwa 2nd year

the goal

Implementation Plan

[Overall business]:
The results of the measurement division and the individual adaptation division will be integrated to construct "integrated human measurement and modeling technology," which is the project objective. Specifically, subject state estimation technology, biofeedback technology, and multimodal stimulation presentation technology will be developed and integrated based on biological big data accumulated by integrating unrestrained and wearable sensing technologies. The developed system will be field tested in real environments in the fields of health and welfare, knowledge education, and skills training to verify its effectiveness and make final adjustments. In addition, the usability and comfort of the system will be evaluated to improve its level of completion for social deployment.

[Evaluation criteria for the achievement of plans and goals]
The technology has been developed to integrate measurement technology and individual adaptation technology, and to estimate the subject's state based on measured biological big data, as well as biofeedback technology and multimodal stimulation presentation technology. In addition, the effectiveness of these technologies has been verified in field experiments both in Japan and overseas, and the project's objective of "integrated human measurement and modeling technology" has been established.