Ali Baba, character from The Arabian NightsCo-developed with Beijing Jiaotong University a multi-modal Mobile-Agent.AIAgent, this AI can simulate a human operating a cell phone.Mobile-Agent utilizes theartificial intelligence (AI)technologies, especially large-scale language models such as GPT-4V, to enable autonomous decision-making and interaction for mobile devices.
The working principle of Mobile-Agent mainly relies on visual perception tools, which can accurately recognize and locate visual and textual elements in the front-end interface of mobile applications. Based on the perceived visual context, Mobile-Agent is able to autonomously plan and decompose complex operational tasks and step-by-step navigate the mobile application for operation.
Experimental results show that Mobile-Agent has high accuracy and completion rate. Even in the face of complex commands for multi-application operations, Mobile-Agent is still able to complete them.
Mobile-Agent is unique:
- Pure visualization solution, independent of XML and system metadata.
- The operation range is unlimited and supports multi-application operation.
- Equipped with a variety of visual perception tools for operational localization.
- Plug and play, no exploration or training required.
In the future Mobile-Agent application scenarios may include automated testing, user behavior simulation, mobile application optimization and so on. The launch of this AI agent will provide a new solution for mobile application development, testing and optimization, and is expected to enhance user experience.
This article comes from users or anonymous contributions, does not represent the position of Mass Intelligence; all content (including images, videos, etc.) in this article are copyrighted by the original author. Please refer to this site for the relevant issues involvedstatement denying or limiting responsibilityPlease contact the operator of this website for any infringement of rights (Contact Us) We will handle this as stated. Link to this article: https://dzzn.com/en/2024/3080.html
