Searched for
MMLU
Researchers unveil ‘Humanity’s Last Exam,’ it's so difficult that today’s AI systems consistently fail itHumanity’s Last Exam (HLE) is a groundbreaking 2,500-question assessment created to reveal the limits of advanced AI systems. Developed by ...- Sarvam unveils two new large language models focused on real-time use, advanced reasoningThe company said the model is optimised for “efficient thinking”, delivering stronger responses while using fewer tokens — a key factor in ...
- AI divide: China, SE Asia ahead of US, Europe in adoptionAccording to the 2025 AI Index Report by Stanford’s Institute for Human-Centered Artificial Intelligence (HAI), AI has proven to be more us...
- Nasscom planning local benchmarks for Indic AI modelsThe plan is in its early stages, with Nasscom AI, the industry body's AI initiative, set to start consultations with industry experts and d...
- Musk says xAI will make kid-friendly app 'Baby Grok'Elon Musk’s AI firm xAI is set to launch "Baby Grok," a separate, kid-friendly chatbot app. Announced via Musk’s X post, the move follows e...
- ChatGPT crosses 365 billion annual searches in 2024: ReportFor perspective, Google took 11 years to achieve the same milestone, said Mary Meeker’s Trends – Artificial Intelligence (AI) report. That’...
- Global AI race intensifies as China closes gap in quality; OpenAI, Google hold strong: ReportChina has been advancing its AI capabilities with the launch of Alibaba's Qwen Series, DeepSeek’s R1, ManusAI and Tencent’s Hunyuan Turbo S...
- What is unique about DeepSeek AI model? Features, cost, US ban - details hereDeepSeek, a Chinese AI startup made a low-cost chatbot and is competing with other AI technologies.
- When AI passes this test, look outAI systems are surpassing traditional tests, prompting the creation of "Humanity's Last Exam", a collection of extremely difficult question...
- ETtech Explainer: What is SearchGPT, OpenAI’s answer to GoogleSearchGPT will provide summarised search results with source links in response to user queries, OpenAI said in a blog post. Users will also...
- Meta unveils biggest Llama 3 AI model, touting language and math gainsMeta’s Llama 3, featuring 405 billion parameters, rivals OpenAI and Amazon. Enhanced coding and math, scoring 73.8 on MATH and 88.6 on MMLU...
- OpenAI unveils cheaper small AI model GPT-4o miniMMLU is a textual intelligence and reasoning benchmark used to evaluate the capabilities of language models. A higher MMLU score signifies ...
- Meta releases early versions of its Llama 3 AI modelThe models will be integrated into virtual assistant Meta AI, which the company is pitching as the most sophisticated of its free-to-use pe...
- ETtech Explained | Google rolls out ChatGPT rival Gemini: its smartest AI model yetGemini is said to be Google’s most flexible large language model (LLM) yet, capable of running on everything from data centres to mobile de...
- ETtech Explainer | Google launches ChatGPT competitor Gemini AI: all you need to knowAlphabet’s highly anticipated AI model Gemini is capable of more sophisticated reasoning and understanding information with a greater degre...
Load More
