Tag: MMLU-Pro

Google Launches Gemini 1.5 Pro for Paid Subscribers
Tech News

Google Launches Gemini 1.5 Pro for Paid Subscribers

Google has been steadily improving its AI chatbot, Gemini, since its initial release. The latest update, the Gemini 1.5 Pro-002 model, is now available to developers and paid subscribers through Gemini Advanced. This follows the recent introduction of Gemini Live, which allows Android users to interact with the AI using voice commands. The Gemini 1.5 Pro-002 model is optimized for solving complex tasks like math, coding, and answering detailed queries with greater efficiency. It surpasses the previous version by enabling deeper conversations and handling more complicated math problems. Google reports a 7% boost in performance on the MMLU-Pro benchmark test, which measures reasoning skills. The model also showed a notable 20% improvement in the Math and HiddenMath benchmark tests. In ...