you are currently viewing::How DeepSeek has changed artificial intelligence and what it means for EuropeMarch 20, 2025--By mid-2024, artificial intelligence large language models (LLMs) were running into diminishing returns to scale in training data and computational capacity. LLM training began to shift away from costly pre-training to cheaper fine-tuning and allowing LLMs to 'reason' for longer before replying to questions. Fine-tuning uses chain-of-thought (CoT) training data that includes questions and the logical steps to reach correct answers. This increases the efficiency of learning for smaller AI models, such as DeepSeek. CoT data can be extracted from large 'teacher' LLMs to train small 'student, models. These changes shift the cost structure of AI models from high pre-training costs to lower fine-tuning costs for model developers and more inference costs for users. Source: bruegel.org |
March 26, 2025-2025 marks a milestone: the tenth anniversary of the Paris Agreement and the deadline for countries to submit their updated Nationally Determined Contributions (NDCs), designed to keep the global goal alive of limiting temperature rise to 1.5℃C above pre-industrial levels.
March 10, 2025-Summary
The developing world's vibrant research in the face of limited resources offers valuable global insights
For too long, Western institutions have shaped empirical research and policy recommendations. Authors based in developing economies have a far too small footprint in top economics journals.