Profile photo

Muhammad Angga Muttaqien

I am a Research Assistant at the Embodied AI Research Team, National Institute of AIST (産業技術総合研究所), working under the supervision of Dr. Ryo Hanai and Dr. Tomohiro Motoda. My research focuses on foundation models, world models, and deep reinforcement learning for building general-purpose robots.

I hold a Master’s degree in AI and Robotics from the University of Tsukuba, where I studied under Prof. Akihisa Ohya as part of the Human-Centered AI Program funded by MEXT. My graduate research explored curriculum-guided deep reinforcement learning for home robots with natural language interaction.

muha.muttaqien@aist.go.jp | CV | Scholar | GitHub

Recent Updates

Research

My research focuses on embodied artificial intelligence, integrating foundation models, world models, and deep reinforcement learning to build general-purpose robots. I envision future AI robots that can perform with unseen objects, layouts, and tasks, while interacting with humans seamlessly (and safely) in the real world.

Publications

Research preview
Visual Prompting for Robotic Manipulation with Annotation-Guided Pick-and-Place Using ACT
Muhammad A. Muttaqien, Tomohiro Motoda, Ryo Hanai, Yukiyasu Domae
2025 IEEE International Conference on Automation Science and Engineering (CASE), Los Angeles, US

TLDR: A perception-action pipeline using annotation-guided visual prompting and Action Chunking with Transformers (ACT) enables adaptive, data-driven pick-and-place operations in cluttered retail environments with improved grasp accuracy and success rates.

Research preview
Attention-Guided Integration of CLIP and SAM for Precise Object Masking in Robotic Manipulation
Muhammad A. Muttaqien, Tomohiro Motoda, Ryo Hanai, Yukiyasu Domae
2025 IEEE/SICE International Symposium on System Integrations (SII), Munich, Germany

TLDR: A structured pipeline integrating CLIP, SAM, and gradient-based attention enhances object masking precision for convenience store products, enabling more accurate and adaptive robotic manipulation through multimodal fine-tuning and effective image-text alignment.

Research preview
Mobile Robots through Task-Based Human Instructions using Incremental Curriculum Learning
Muhammad A. Muttaqien, Ayanori Yorozu, Akihisa Ohya
2024 IEEE International Conference on Cybernetics and Intelligent Systems (CIS), Hangzhou, China

TLDR: An incremental curriculum learning (ICL) framework combined with deep reinforcement learning (DRL) enables robots to progressively master task-based navigation from human instructions, improving training efficiency, generalization, and performance in dynamic indoor environments.

Research preview
Precision and Adaptability of YOLOv5 and YOLOv8 in Dynamic Robotic Environments
Victor A. Kich, Muhammad A. Muttaqien, Junya Toyama, Ryutaro Miyoshi, Yosuke Ida, Akihisa Ohya, Hisashi Date
2024 IEEE International Conference on Cybernetics and Intelligent Systems (CIS), Hangzhou, China

TLDR: A comparative analysis of YOLOv5 and YOLOv8 reveals that YOLOv5 can match or surpass YOLOv8 in precision for robotic object detection, highlighting the importance of architectural simplicity, dataset factors, and contextual evaluation in selecting real-time detection frameworks.

Projects

Project preview
ALOHA + GR00T System Integration
2025 — National Institute of AIST

TLDR: This project integrates ALOHA (a bimanual robotic manipulator) with a fine-tuned GR00T foundation model using our prepared demonstration data to perform pick-and-place operations on diverse products in Japanese convenience stores.

Project preview
Tsukuba Challenge 2023
2023 — University of Tsukuba

TLDR: Collaborated with colleagues from the Intelligent Robot Laboratory at the University of Tsukuba to develop a mobile robot capable of seamless navigation along predefined outdoor routes. The team successfully completed the challenge and was recognized among the top-performing entries in the competition. 🎉

Projects preview
Industrial AI Projects
2018-2021 — GRID Co., Ltd. (株式会社グリッド), Tokyo

TLDR: As an AI Research Engineer, contributed to multiple industrial AI applications, including Unit Commitment Automation for thermal and hydro power systems, mechanical drawing analysis, material property segmentation, and road damage detection for Nichireki Corporation.

About Me

I was born and raised in Indonesia and am currently based in Tokyo, Japan. Beyond research, I enjoy exploring the intersection between technology, philosophy, and human understanding —reflecting on how AI as the most disruptive technology of the 21st century shapes our perception of knowledge and human thinking. In my spare time, I like reading thought-provoking books (such as Sapiens and LIFE 3.0), writing analytical essays, and playing strategy-based games.