Translartion. Region: Russians Fedetion –
Source: Novosibirsk State University – Novosibirsk State University –
The Telegram bot “Smart Mirror” appeared a month ago. The application is available to any user of this messenger. The author of the product is a specialist of the NSU Startup Studio and deputy director of the company “Save Technologies” Ksenia Ivanova. Now students of the Institute of Intelligent Robotics of NSU have joined the development as part of their course on project activities.
This TG application can also be used as a regular mirror if you don’t have one at hand, but need to fix your hair or refresh your makeup. However, its capabilities are not limited to this, because this is not a simple mirror, but a “smart” one.
So far, the Telegram bot can identify several skin conditions. It estimates the percentage of how healthy your skin is and can recognize signs of several problems. Such as acne, psoriasis, eczema, warts, ringworm. If it determines the skin is healthy, it will advise you to continue your current care and use sunscreen. If the Smart Mirror suspects any abnormalities in your skin condition, it will advise you to see a specialist for a more detailed diagnosis or problem determination, and then for treatment.
— During the joint work of the NSU Startup Studio with a company producing non-medical skin care products on another project, we came up with the idea of such an application, but we did not intend to sell it, since the problem solved by the mirror has great social significance. We are developing it for two reasons: we see a serious problem in the market, when women cannot decide which products to use, which of them are effective and whether they help over time.
We found a suitable dataset and models of skin conditions in the public domain, on the basis of which we trained our application to recognize skin conditions. We used the open model yolo8 as a basis for recognition and mediapipe as an auxiliary library. It is important that the model is trained on a dataset of diseases, for us this is a good social start, but then we will enrich it with those problems that everyone may have, – said Ksenia Ivanova.
The “Smart Mirror” works simply: the user opens the application in Telegram, grants it access to the camera of their smartphone, slowly turns their face in front of the display, on which the answer appears after a few minutes. You can also use the application via a computer, but due to the quality of the camera, a smartphone is still preferable. It is important that there is sufficient lighting, it is best to sit opposite the light source.
The developers recommend using the Smart Mirror in the morning – after using your daily skin care products, but before applying makeup – through it, the Smart Mirror will not see the real state of your skin and can determine it as healthy with a high degree of probability, without noticing any problematic conditions, if they exist, but are hidden under a layer of foundation and powder.
The Smart Mirror launched a month ago, but its creators have already received a lot of positive feedback about their application. Many found it interesting and useful. But the developers are not going to stop there.
— So far, we have presented the beta version of our application to users so that they can get to know it and learn how it works. We want our Smart Mirror to be in demand, so we have developed a plan for the further development of our project and want to teach our application a lot more. For example, to remind about the need to remove makeup before skin monitoring. We will also expand the list of unhealthy skin conditions that the Smart Mirror will be able to recognize, for example, we will definitely include such a skin problem as rosacea. We will also introduce recommendations for skin care – both healthy and problematic. Since we are not going to commercialize our project, our chatbot will not recommend any specific brands of skin care products, but will indicate the active ingredients that should be paid attention to when choosing a cream or lotion. We also plan to teach the Smart Mirror to offer users instructions for self-massage of the face and exercises for the elasticity of the skin and facial muscles, — said Ksenia Ivanova.
According to the developers, the “Smart Mirror” should become a faithful assistant for its users and a guide on the path to maintaining the beauty and health of the skin. To do this, they plan to teach the application to make a high-quality analysis of its condition so that users can evaluate how effective their actions were aimed at skin care and overcoming existing problems.
— Many women are concerned about such a problem as bags under the eyes. We want to teach our “Smart Mirror” to help solve this problem. The user looks into it in the morning, the application measures the volume of bags under the eyes and gives its recommendations regarding the drinking regime, duration of sleep and other important points in this case. If they are followed, the user can return to the application in the evening, as well as after a few days, to find out whether changes have occurred and how noticeable they were, — explained Ksenia Ivanova.
The TG application “Smart Mirror” is available at the link: HTTPS: //t. TA/ARMIRRORBOT
Please note: This information is raw content directly from the source of the information. It is exactly what the source states and does not reflect the position of MIL-OSI or its clients.