Xiaomi AI Lab Director Wang Bin reveals: the future will be a coexistence of large and small models, generalized and specialized

milletblocsAIWang Bin, director of the lab and chief scientist of natural language processing (NLP), said in a recent interview with Sound Motion Alive that the future must be a state of coexistence of large and small models, and of general-purpose and special-purpose coexistence.

Wang Bin explained Xiaomi's considerations for finding a balance between AI model scale and hardware threshold. First, Xiaomi has a large number of devices, and the computing power of these devices has been significantly increased. Second, as a company on the heavy end side, it is costly to call a lot of cloud computing power. In addition, user privacy and network conditions when using the phone are also among Xiaomi's considerations.

However, a large model with too small a number of parameters can also affect the user experience. Therefore, Xiaomi plans to strike a balance between model size and hardware threshold. Wang Bin believes that in addition to generalized capabilities, smaller models with different dimensions may be better suited for a particular task. Therefore, a hybrid form may eventually emerge, with both cloud and end-side, and both large and small models. Through a common ecology, Xiaomi is committed to maximizing the user experience.

It is worth mentioning that millet has been laying out AI for many years. Lei Jun announced in his 2023 annual speech that millet has laid out 12 technical fields and 99 subdivided tracks, and plans to invest 100 billion yuan in technology in the next five years. Since July 2016, millet has begun to lay out in the field of AI, and in April this year, a large model team was established, with a relevant team of more than 3,000 people.

Currently.Ai-chan.Upgrades to the AI big modeling capabilities have begun, but have not yet been opened up on a wide scale.