Scott was selected as a research implementer for the "Awakening Project.
Scott has been selected as one of the research implementers of the "Awakening Project," a deep-tech research and development project by young human resources at AIST.
Scott's participation in the Awakening Project is not as a member of the Playbox team, but as an individual.
What is the Awakening Project?
The Awakening Project was established by the National Institute of Advanced Industrial Science and Technology (AIST) as a project to support and foster "advanced research personnel in the field of deep technology.
This year, the project called for R&D themes that aim to solve social issues by utilizing AI technology and bioinformatics, and 11 themes (18 researchers in total) were selected for the project.
The selected themes will be pursued until the end of July 2024, with the support of a PM and supervisor (SV) in charge of the research.
For details, please visit the Awakening Project website ( https://kakusei.aist.go.jp ).
What will be conducted?
In collaboration with Mr. Taiga Someya, a second-year master's student at the University of Tokyo, we will work on the theme of "Development of a large-scale multimodal model in which multi-agent movement and action sequences can be input.
The current LLM is difficult to analyze videos in which the spatial movement of people and objects is important, and it is particularly difficult to analyze
-
Computational complexity of handling videos
-
Inability to capture the complex movements of multiple people
-
Consideration of context over long periods of time
The current LLM has the following problems.
Therefore, this research aims to construct an LLM that can efficiently and accurately interpret videos of a certain length and in which the movements and interactions of multiple people are important.
Accepted by AIST (@AIST_JP ) under the Awakening PJ 🎉.
- Atom Scott (@AtomJamesScott) December 8, 2023
Co-researcher: Mr. Someya (@agiats_football )
PM: Dr. Taninaka (@verypluming )
The theme of this project is "Development of a large-scale multimodal model that can input multi-agent movement and action sequences",
We're developing an LLM that understands human movement ⚽️⚽️https://t.co/r97TaRSxie
Comment.
We are very pleased to have been selected for the first AIST Awakening Project. Although this research will be domain-focused and use soccer data, it has broad applicability and is expected to be particularly effective in situations where human movement and interaction are important. I look forward to this opportunity to work on research that can take full advantage of ABCI and expand my connections in the research community.
(Scott)
