Source: Panasonic
Headline: Panasonic HD develops SegLLM, an interactive segmentation technology that allows for image referencing, enabling recognition under complex conditions
Osaka, Japan, April 17, 2025 – Panasonic R&D Company of America (PRDCA) and Panasonic Holdings Co., Ltd. (Panasonic HD), in collaboration with researchers from the University of California, Berkeley (UC Berkeley), have developed SegLLM, an interactive segmentation technology that allows users to specify recognition targets using language and reference images.
Segmentation is a technology that divides an image into multiple regions at the pixel level. By integrating with image recognition, it enables the detection of specific objects and accurately captures their position and shape. This makes it applicable to various fields, such as object recognition in factories, environmental recognition around vehicles and object manipulation by robots. Recently, in the field of image recognition, there has been an increasing use of large language models (LLMs) to specify recognition targets using text. However, when providing instructions interactively, if new instructions are based on objects recognized in past interactions, the text can become complex, leading to a higher likelihood of misrecognition. The newly developed SegLLM addresses this issue by allowing the input of both text and reference images into prompts, enabling the recognition of hierarchical relationships between objects and interactions among objects, even for untrained objects. It also makes it possible to recognize only specific objects in more complex scenes where there are many similar looking objects.
This technology has been internationally recognized for its advanced capabilities and has been accepted at the International Conference on Learning Representations (ICLR 2025), a leading conference in AI and machine learning technologies. It will be presented at the conference held in Singapore from April 24 to April 28, 2025.
Future Outlook:
The newly developed SegLLM is a technology that significantly enhances the performance of interactive segmentation. Panasonic HD plans to implement this technology into the automatic annotation tool they are developing with FastLabel. By expanding the range of application to include targets that are difficult to detect with traditional text-only instructions, such as untrained objects or items held by specific individuals, this tool will evolve into a more versatile solution. Leveraging the characteristics of SegLLM, it can reduce training costs on-site in factories and production lines where a wide variety of instruments and tools exist. This will accelerate optimization in factories and similar environments through applications in Cyber-Physical Systems (CPS).
Panasonic HD will continue to accelerate the implementation of AI in society and promote research and development of AI technologies that will contribute to improving our customers’ lives and workplaces.
* [Press Release] Panasonic R&D Company of America Develops New Multimodal Foundation Model That Can Perform Image Recognition and Segmentation in Response to Any Text Input (Nov 21, 2023)https://news.panasonic.com/global/press/en231121-5
Related Information:
“SegLLM: Multi-round Reasoning Segmentation”This research is the result of a collaborative effort between Konstantinos Kallidromitis from PRDCA, Xudong Wang from UC Berkeley, and Yusuke Kato and Kazuki Kozuka from Panasonic HD.https://arxiv.org/abs/2410.18923Panasonic × AI websitehttps://tech-ai.panasonic.com/en/
About the Panasonic Group
Founded in 1918, and today a global leader in developing innovative technologies and solutions for wide-ranging applications in the consumer electronics, housing, automotive, industry, communications, and energy sectors worldwide, the Panasonic Group switched to an operating company system on April 1, 2022 with Panasonic Holdings Corporation serving as a holding company and eight companies positioned under its umbrella. The Group reported consolidated net sales of 8,496.4 billion yen for the year ended March 31, 2024. To learn more about the Panasonic Group, please visit: https://holdings.panasonic/global/