The YandexGPT (YaLM 2.0) neural network has learned to remember dialogs with users

The YandexGPT neural network (YaLM 2.0) has moved to a new level. It can now remember previous lines and maintain the context of the conversation, which allows it to communicate with the user as a person who follows the thread of the conversation.

The new "Let's Make Up" mode is already popular among users: within a few weeks of its launch, two million people used it. It was first available in Yandex Browser, the Yandex app, Stations and TVs with Alice, and then appeared on the main page of Yandex (ya.ru).

How does the new mode work? In fact, context support is a technically complex task, and to solve it, the YandexGPT neural network was further trained on reference examples of impersonal dialogs. The automatic trainer trained the model to give the most relevant response to queries, taking into account the context of previous replicas. The Yandex team also used dialogs from the open source Open Assistant dataset.

Thanks to context support, communicating with Alice has become much more convenient: now you can clarify your request without repeating it in its entirety. At the user's request, Alice can give advice, act as a business partner or co-author. With her help you can discuss a business plan, compare pros and cons of buying a car or prepare for a job interview. She will come up with slogans, ideas for startups, and dozens of post options for different audiences.

Yandex was the first company in the world to implement such a large next-generation language model in a virtual assistant. The neural network was trained on Yandex supercomputers, the most powerful in Russia and Eastern Europe. The Yandex team spoke in detail about how YandexGPT was created, on Habra.

Contextual communication with a virtual assistant is a new step in the development of artificial intelligence. Context support allows you to create a more natural, human-like communication with the machine. YandexGPT has become even more versatile and flexible thanks to the new "Let's make it up" mode. It opens up huge possibilities for working with the virtual assistant on a new level.