Here is a short list of some of my recent work, for a full publication list see my
Google Scholar
or
Semantic Scholar
author page.
* denotes equal contribution.
|
|
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Matt Deitke,
Christopher Clark,
Sangho Lee,
Rohun Tripathi,
Yue Yang,
Jae Sung Park,
Mohammadreza Salehi,
Niklas Muennighoff,
Kyle Lo,
Luca Soldaini,
Jiasen Lu,
Taira Anderson,
Erin Bransom,
Kiana Ehsani,
Huong Ngo,
YenSung Chen,
Ajay Patel,
Mark Yatskar,
Chris Callison-Burch,
Andrew Head,
Rose Hendrix,
Favyen Bastani,
Eli VanderBilt,
Nathan Lambert,
Yvonne Chou,
Arnavi Chheda,
Jenna Sparks,
Sam Skjonsberg,
Michael Schmitz,
Aaron Sarnat,
Byron Bischoff,
Pete Walsh,
Chris Newell,
Piper Wolters,
Tanmay Gupta,
Kuo-Hao Zeng,
Jon Borchardt,
Dirk Groeneveld,
Jen Dumas,
Crystal Nam,
Sophie Lebrecht,
Caitlin Wittlif,
Carissa Schoenick,
Oscar Michel,
Ranjay Krishna,
Luca Weihs,
Noah A Smith,
Hannaneh Hajishirzi,
Ross Girshick,
Ali Farhadi,
Aniruddha Kembhavi
(2024)
|
|
|
|
|
PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators
Kuo-Hao Zeng,
Zichen Zhang,
Kiana Ehsani,
Rose Hendrix,
Jordi Salvador,
Alvaro Herrasti,
Ross Girshick,
Aniruddha Kembhavi,
Luca Weihs
(2024)
Accepted at CoRL
Oral
|
|
|
|
Seeing the Unseen: Visual Common Sense for Semantic Placement
Ram Ramrakhya,
Aniruddha Kembhavi,
Dhruv Batra,
Zsolt Kira,
Kuo-Hao Zeng,
Luca Weihs
(2024)
Accepted at CVPR
Code available
|
|
|
|
SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World
Kiana Ehsani*,
Tanmay Gupta*,
Rose Hendrix*,
Jordi Salvador*,
Luca Weihs*,
Kuo-Hao Zeng*,
Kunal Pratap Singh,
Yejin Kim,
Winson Han,
Alvaro Herrasti,
Ranjay Krishna,
Dustin Schwenk,
Eli VanderBilt,
Aniruddha Kembhavi
(2024)
Accepted at CVPR
Code available
|
|
|
|
Promptable behaviors: Personalizing multi-objective rewards from human preferences
Minyoung Hwang,
Luca Weihs,
Chanwoo Park,
Kimin Lee,
Aniruddha Kembhavi,
Kiana Ehsani
(2024)
Accepted at CVPR
Code available
|
|
|
|
|
Holodeck: Language guided generation of 3d embodied ai environments
Yue Yang*,
Fan-Yun Sun*,
Luca Weihs*,
Eli VanderBilt,
Alvaro Herrasti,
Winson Han,
Jiajun Wu,
Nick Haber,
Ranjay Krishna,
Lingjie Liu,
Chris Callison-Burch,
Mark Yatskar,
Aniruddha Kembhavi,
Christopher Clark
(2024)
Accepted at CVPR
Code available
|
|
|
|
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy
Zichen Zhang,
Yunshuang Li,
Osbert Bastani,
Abhishek Gupta,
Dinesh Jayaraman,
Yecheng Jason Ma,
Luca Weihs
(2024)
Accepted at ICRA
ICRA'24 Best Paper Award Finalist (Robot Vision)
Code available
|
|
|
|
Objaverse: A universe of annotated 3d objects
Matt Deitke,
Dustin Schwenk,
Jordi Salvador,
Luca Weihs,
Oscar Michel,
Eli VanderBilt,
Ludwig Schmidt,
Kiana Ehsani,
Aniruddha Kembhavi,
Ali Farhadi
(2023)
Accepted at CVPR
Code available
|
|
|
|
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation
Matt Deitke,
Eli VanderBilt,
Alvaro Herrasti,
Luca Weihs,
Kiana Ehsani,
Jordi Salvador,
Winson Han,
Eric Kolve,
Aniruddha Kembhavi,
Roozbeh Mottaghi
(2022)
Accepted at NeurIPS
Outstanding Paper Award @ NeurIPS'22
Code available
|
|
|
|
Benchmarking progress to infant-level physical reasoning in AI
Luca Weihs,
Amanda Yuile,
Renée Baillargeon,
Cynthia Fisher,
Gary Marcus,
Roozbeh Mottaghi,
Aniruddha Kembhavi
(2022)
Accepted at TMLR
Code available
|
|
|
|
Learning Generalizable Visual Representations via Interactive Gameplay
Luca Weihs,
Aniruddha Kembhavi,
Kiana Ehsani,
Sarah M. Pratt,
Winson Han,
Alvaro Herrasti,
Eric Kolve,
Dustin Schwenk,
Roozbeh Mottaghi,
Ali Farhadi
(2021)
Accepted at ICLR
Code available
|
|
|
|
AllenAct: A Framework for Embodied AI Research
Luca Weihs,
Jordi Salvador,
Klemen Kotar,
Unnat Jain,
Kuo-Hao Zeng,
Roozbeh Mottaghi,
Aniruddha Kembhavi
(2020)
Code available
|
|
|
|
Half-trek criterion for identifiability of latent variable models
Rina Foygel Barber,
Mathias Drton,
Nils Sturma,
Luca Weihs
(2022)
Accepted at Annals of Statistics
Code available
|
|
|
|
Symmetric Rank Covariances: a Generalised Framework for Nonparametric Measures of Dependence
Luca Weihs,
Mathias Drton,
Nicolai Meinshausen
(2018)
Accepted at Biometrika
Code available
|
|
|
