Amid escalating bot war, the Technology Innovation Institute (TII), a global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has upped its generative AI credentials with the launch of “Falcon LLM,” a foundational large language model (LLM) with 40 billion parameters.
AI and Digital Science Research Center’s (AIDRC) AI Cross-Center Unit, the team behind building Noor, the world’s largest Arabic language model, built Falcon LLM, the model which allegedly outperforms GPT3.
Falcon LLM 40B model is trained on one trillion tokens. The model uses only 75 percent of GPT-3’s training compute, 40 percent of Chinchilla’s, and 80 percent of PaLM-62B’s.
Read more: ChatGPT4 is the new, improved version of its generative AI self
Today, the recent advancements in large language models have demonstrated their ability to generate creative text, solve complex problems, and offer significant benefits to billions of people. LLMs can be used in a wide range of applications, such as chatbots, virtual assistants, language translation, content generation, and sentiment analysis.
They can help businesses streamline their customer service operations by providing efficient and effective responses to customer inquiries. This deep tech is allowing companies and countries to garner huge savings – from improving efficiencies to cutting down labor costs and identifying new revenue streams – simply with its implementation in businesses or departments. Further, on-premises LLMs are ideal for organizations requiring real-time processing and managing confidential or proprietary data. This is critical for safeguarding data privacy to maintain a competitive advantage.
Falcon is not yet commercially available, and a timeline was not disclosed, but the ambition is to eventually offer the model to government entities, start-ups, and the private sector so the economy is less dependent on LLMs provided by major tech players in the increasingly competitive artificial intelligence space.
“My top priority is to pave the way for the development of more powerful and advanced technologies in the UAE,” Ebtesam Almazrouei, a director in the AI research lab at TII, said.
Moreover, Falcon’s accuracy, bias, and ability to reason will also be tested and those results are expected to be made public in the coming weeks as well.
In mid-March, OpenAI announced the latest update to its GPT model, called GPT-4, describing it as the “safer and more aligned” successor.
For more tech-related news, click here.
