Sophie Wang

@SophieLWang

Studying intelligent representations @MIT_CSAIL

sophielwang.com

2023年11月からXを利用しています

164 フォロー中

3,265 フォロワー

固定
Sophie Wang
@SophieLWang
10月6日
Can “chicken” make a base model reason? 🐔 Yes! Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too. blog: sophielwang.com/cues
49
Sophie Wang
@SophieLWang
10月19日
From the archives 🦫
1
Sophie Wang
@SophieLWang
10月12日
I wrote a blog post detailing the writing approach I took while working on my recent paper: sophielwang.com/blog/paper-wri… I describe the behind the scenes for how this paper came to be, why and how I storyboarded figures before running experiments, and some figure design tips! :)
Sophie Wang
@SophieLWang
10月6日
00:10
Can “chicken” make a base model reason? 🐔 Yes! Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too. blog: sophielwang.com/cues
34
Sophie Wang
@SophieLWang
10月9日
Super interesting work showing that representations can be aligned across modalities using an orthogonal transformation!
Dominik Schnaus
@dominik_schnaus
10月9日
DINOv2 has never seen a caption, and Qwen3 has never seen an image. We still aligned their embedding spaces without a single image-caption pair. It even works when the images and the captions come from different datasets. Project page: dominik-schnaus.github.io/unpaired-roset… ⬇️
1
Sophie Wang
@SophieLWang
10月7日
In our blog post, you can interactively explore the reasoning effect of token cues and RL on base models! 📎 paper: arxiv.org/abs/2610.06851 ✍ blog: sophielwang.com/cues 💻 code: github.com/sophicle/cues
Sophie Wang
@SophieLWang
10月6日
00:10
Can “chicken” make a base model reason? 🐔 Yes! Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too. blog: sophielwang.com/cues
12

Sophie Wang

Sophie Wangさんのポスト