“The researchers based s1 on Qwen2.5, an open-source model from Alibaba Cloud. They initially started with a pool of 59,000 questions to train the model on, but found that the larger data set didn’t ...
The starting point of the project was Qwen2.5-32B-Instruct, an open-source LLM released by Alibaba Group Holding Ltd. last year. The researchers created s1-32B by customizing Qwen2.5-32B-Instruct ...
DeepSeek's R1 model release and OpenAI's new Deep Research product will push companies to use techniques like distillation, supervised fine-tuning (SFT), reinforcement learning (RL), and ...