act in accordance withartificial intelligence (AI)News site The Decoder reports thatMetaThere may be a development in the pipeline for a more powerful than GPT-4AIlarge model, called Llama 3, and plans to keep it open source and free.
The report mentions that the news came fromOpenAIof engineers who have served asGoogle Internet company Jason Wei of Brain Engineers, got the tip while attending a social event for Meta's Generative AI Group.
Jason Wei noted that Meta now has enough computing power for Llama 3 and 4 training. He revealed that Llama 3 is aiming to reach the performance level of GPT-4, but will still be available to users for free. However, Meta has yet to officially announce the release plans for Llama 3. Although the source is reliable, the possibility that there may be errors in it cannot be ruled out.
It is worth noting that it took Meta a total of about five months from the release of Llama 1 in late February 2023 to the release of Llama 2 in late July 2023.GPT-4 utilizes a more complex hybrid architecture with 16 expert networks, each with about 111 billion parameters, which may be the secret to its high performance. As a result, upgrading from Llama 2 to Llama 3 may require more challenging work and may take longer than the leap from Llama 1 to Llama 2.
It is interesting to note that Llama 2 has already reached the GPT-3.5 level in some application areas and is being continuously fine-tuned and extended in functionality by the open source community. For example, the recently released Code Llama is based on Llama 2, and through fine-tuning has already achieved GPT-3.5 and GPT-4 level scores in the HumanEval coding benchmark (the exact effect depends on the type of measurement). However, Meta points out in his paper that despite this, there is still a large performance gap between Llama 2 and closed-source models such as GPT-4 and Google's PaLM-2. Thus, it remains to be seen whether Llama 3 will be able to outperform GPT-4.
This article comes from users or anonymous contributions, does not represent the position of Mass Intelligence; all content (including images, videos, etc.) in this article are copyrighted by the original author. Please refer to this site for the relevant issues involvedstatement denying or limiting responsibilityPlease contact the operator of this website for any infringement of rights (Contact Us) We will handle this as stated. Link to this article: https://dzzn.com/en/2023/696.html
