UAE releases 'Falcon 2', an open source AI model that rivals Google's AI
On May 13, 2024, the Technology Innovation Institute (TII), a government research institute in the United Arab Emirates, announced the launch of Falcon 2, an open source large-scale language model (LLM) that outperforms Meta's Llama 3 8B and has performance equivalent to Google's Gemma 7B.
Falcon 2: UAE's Technology Innovation Institute Releases New AI Model Series, Outperforming Meta's New Llama 3 | Technology Innovation Institute
Abu Dhabi's Technology Innovation Institute Unveils Falcon 2
https://www.maginative.com/article/abu-dhabis-technology-innovation-institute-unveils-falcon-2/
UAE Releases New Falcon AI Model 11B to Rival Meta's Llama, OpenAI and Google - Bloomberg
https://www.bloomberg.com/news/articles/2024-05-13/uae-releases-new-falcon-ai-model-11b-to-rival-meta-s-llama-openai-and-google
The Falcon 2 series announced this time consists of two models: the Falcon 2 11B, an LLM trained on 5.5 trillion tokens with 11 billion parameters, and the Falcon 2 11B VLM, a multi-modal model specialized for image-to-text conversion.
The previous model, Falcon, released in 2023, had a maximum of 7 billion parameters and boasted the best performance of any open source model at the time.
Open source, commercially available large-scale language model 'Falcon' has appeared, the best performance among open source models - GIGAZINE
According to the announcement, in an independent test conducted by Hugging Face, the Falcon 2 11B outperformed the Llama 3 8B, an open LLM released by Meta in April 2024, and demonstrated performance comparable to Google's open LLM Gemma 7B .
The Falcon 2 11B is available in English, German, Spanish, French, Italian, Portuguese, Polish, Dutch, Romanian, Czech and Swedish, making it a versatile model with excellent efficiency and accessibility.
In addition, the Falcon 2 11B VLM is a multi-modal model with the ability to identify and interpret visual data, which is expected to have applications in a wide range of industries, including healthcare, finance, e-commerce, education and law. Specific use cases include the analysis of chest x-rays, educational documents and building blueprints.
The Falcon 2 series will be available in a variety of sizes, and its performance will be refined through advanced machine learning features such as Mixture of Experts (MoE) , a method of integrating multiple specialized neural networks.
What's particularly important is that both models are open source models and can be accessed by developers around the world without restriction. TII plans to establish the Falcon Foundation, a non-profit organization modeled after the Linux Foundation, to transfer the development of the Falcon series to it, and the charter of the new organization will state that 'Falcon will forever remain an open source model.'
'The Falcon 2 11B has demonstrated outstanding performance, but we see this as a commitment to the open source movement and the Falcon Foundation,' said Faisal Al Bannai, Secretary General of the Council for Advanced Technology Research, the government agency that funds the TII. 'Other multimodal models will be coming to market soon in a range of sizes, as we strive to ensure that privacy-conscious developers and operators have access to one of the best AI models.'
You can access the Falcon 2 11B at:
tiiuae/falcon-11B · Hugging Face
https://huggingface.co/tiiuae/falcon-11B
Related Posts:
in Software, Posted by log1l_ks