Anthony Liang

Ph.D. Student, University of Southern California

I am a third-year Ph.D. student at the University of Southern California coadvised by Jesse Thomason (GLAMOR Lab) and Erdem Bıyık (LiRA Lab). I work in natural language and reinforcement learning (RL), and some of my recent works focuses on using natural language supervision to accelerate hierarchical RL. I am currently a Student Researcher at Google working with Chih-wei Hsu, Yinlam Chow and Guy Tennenholtz on sequential-decision making with dynamic latent contexts. I previously interned at Meta Reality Lab with Paul Crook and Andrea Matto working on task-oriented dialogue systems using LLMs.

Prior to joining USC, I spent a summer (during the pandemic) as a visiting scholar at CMU working with Changliu Liu. I graduated from the University of Michigan (UM) with a Masters in Robotics and Bachelors in Computer Science where I worked with Wilka Carvalho and Honglak Lee. During my undergrad summers, I interned at Amazon, Invisible.ai, Google Ads, Luminar and Socratic.

Feel free to say hi: anthony dot liang at usc dot edu


News

May 2023 Student Researcher at Google working on Preference Elicitation with the Machine Intelligence group
May 2022 Started at Meta Reality Lab as an NLP Research Intern working on Task-Oriented Dialogue Systems using LLMs
Sept 2021 Started my Ph.D. at USC with the GLAMOR group!
May 2021 Applied Scientist Intern at Amazon
Oct 2020 Preprint out on arXiv: Reinforcement Learning for Sparse-Reward Object-Interaction Tasks
Sept 2020 Started as a Robotics Masters student at the University of Michigan.
May 2020 Visiting Scholar with Prof. Changliu Liu at the Intelligent Controls Lab!
May 2020 Graduated with a Bachelors degree in Computer Science and minor in Mathematics!

Publications

visarl

DynaMITE-RL: A Dynamic Model for Improved Temporal Meta-Reinforcement Learning

Anthony Liang, Guy Tennenholtz, Chih-wei Hsu, Yinlam Chow, Erdem Bıyık, Craig Boutilier

In submission to ICML 2024


visarl

ViSaRL: Visual Reinforcement Learning Guided by Human Saliency

Anthony Liang, Jesse Thomason, Erdem Bıyık

ICRA 2023 Pretraining for Robotics Workshop (PT4R)

Spotlight Talk (Top 15% of submissions)


transformer_adapters

Transformer Adapters for Robot Learning

Anthony Liang, Ishika Singh, Karl Pertsch, Jesse Thomason

CoRL 2022 Workshop on Pretraining for Robot Learning

Spotlight Talk


load

Reinforcement Learning for Sparse-Reward Object-Interaction Tasks in First-person Simulated 3D Environments

Wilka Carvalho, Anthony Liang, Kimin Lee, Sungryull Sohn, Honglak Lee, Richard L. Lewis, Satinder Singh

International Joint Conference on Artificial Intelligence 2021

NeurIPS Deep Reinforcement Learning 2020 Workshop



Teaching

CSCI 699: Robot Learning Fall 2024
CSCI 499: Interactive Natural Language Processing Fall 2023
EECS 442: Computer Vision Winter 2021
EECS 498: Algorithmic Robotics Winter 2020
EECS 504: Graduate Computer Vision Fall 2020
EECS 280: Introduction to Programming and Data Structures Fall 2018, Winter 2018, Fall 2019