Saving Lives with AI Health Coaching

India's largest healthcare platform Healthify has over 40 million users and supports weight loss and improvement of metabolic diseases through AI-based coaching. So far, AI has helped users lose a total of more than 25 million pounds.

Previously, the company operated its own AI models, including Ria (a virtual nutritionist) and Snap (food photo recognition). However, Snap struggled to recognize photos containing multiple foods, keeping usage at only 10-20%, and Ria, being a rule-based system, had difficulty responding to complex nutrition-related questions.

To solve this, Healthify adopted OpenAI's technology. With GPT-4 Vision, it became possible to instantly recognize a diverse range of foods from around the world as well as multiple types of food in a single photo, and by leveraging GPT-4 and Whisper, the performance of the coaching service was dramatically improved. As a result, a single coach can now manage up to 300 customers simultaneously.

In addition, by using the Embeddings model, the company implemented sophisticated food data matching that goes beyond simple text matching, and through easy fine-tuning, it became possible to quickly build and operate models optimized for its own data.