CLeAR
  • Home
  • News
  • Publications
  • People
  • Software & Data
  • Research
    Touch Trust Learn Generate
  • About Us
1 Posts

AAMAS

The Dynamics of Q-learning in Population Games
social learn AAMAS

The Dynamics of Q-learning in Population Games

We develop an accurate physics-inspired model for describing how a population of Q-learning agents adapt as they interact.

CLeAR
CLeAR 09 May 2022
1 Posts

AI-HRI

Observed Adversaries in Deep Reinforcement Learning
learn AI-HRI

Observed Adversaries in Deep Reinforcement Learning

We examine the problem of observed adversaries for deep policies, where observations of other agents can hamper robot performance.

Eugene Lim
Eugene Lim 13 Oct 2022
1 Posts

AIES

Fairness meets CMDPs
social fairness learn AIES

Fairness meets CMDPs

This paper proposes SCALES, a general framework that translates well-established fairness principles into a common representation based on CMDPs.

Sreejith Balakrishnan
Sreejith Balakrishnan 01 Aug 2022
1 Posts

Arxiv

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms
social simulation Arxiv

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms

We design an LLM-driven social-scenario simulation pipeline (SocRATES) to enable more holistic evaluation of social navigation algorithms. SocRATES generates context- and location-appropriate scenarios from simple text and image-based inputs, thus reducing the labor-intensive task of scenario proposal and synthesis that is typically required for scenario-based testing.

Shashank Rao Marpally
Shashank Rao Marpally 30 Dec 2024
1 Posts

CVPR

A characteristic function approach to deep implicit generative modeling
learn generative CVPR

A characteristic function approach to deep implicit generative modeling

We present a new method for training GANs via characteristic functions

Abdul Fatir Ansari
Abdul Fatir Ansari 14 Jun 2020
5 Posts

HRI

Getting to Know One Another Calibrating Intent, Capabilities and Trust for Human-Robot Collaboration
social trust HRI

Getting to Know One Another Calibrating Intent, Capabilities and Trust for Human-Robot Collaboration

We address the problem of intention and capability calibration in human-robot collaboration with a decision-theoretic approach.

Joshua Lee
Joshua Lee 24 Oct 2020
Modeling the Interplay of Trust and Attention in HRI an Autonomous Vehicle Study
social trust HRI

Modeling the Interplay of Trust and Attention in HRI an Autonomous Vehicle Study

We study and model how trust and attention affect how humans interact with autonomous vehicles.

CLeAR
CLeAR 23 Mar 2020
Juiced and Ready to Predict Private Information in Deep Cooperative Reinforcement Learning
learn HRI

Juiced and Ready to Predict Private Information in Deep Cooperative Reinforcement Learning

Training robots that can interactively assist humans with private information

Eugene Lim
Eugene Lim 01 Mar 2020
Robot Capability and Intention in Trust-based Decisions across Tasks
social trust HRI

Robot Capability and Intention in Trust-based Decisions across Tasks

We present results from a human-subject study designed to explore two facets of human mental models of robots - inferred capability and intention - and their relationship to overall trust and eventual decisions.

Yaqi Xie
Yaqi Xie 11 Mar 2019
Planning with Trust for Human-Robot Collaboration
social trust HRI

Planning with Trust for Human-Robot Collaboration

Robot decision-making with Human Trust.

Harold Soh
Harold Soh 01 Mar 2018
1 Posts

ICLR

Discriminator Gradient Flow
generative learn ICLR

Discriminator Gradient Flow

Using Gradient Flows to Refine Samples from Deep Generative Models

Abdul Fatir Ansari
Abdul Fatir Ansari 12 Feb 2021
1 Posts

ICML

Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series
learn ICML

Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series

We develop a family of stable continuous-time neural state space-models.

Abdul Fatir Ansari
Abdul Fatir Ansari 24 Apr 2023
6 Posts

ICRA

Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation
learn navigation ICRA

Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation

We introduce a novel framework centered around the Probable Object Location (POLo) score, which allows the agent to make data-driven decisions for efficient object search.

Jiaming Wang
Jiaming Wang 19 Apr 2024
Safety-Constrained Policy Transfer with Successor Features
learn ICRA

Safety-Constrained Policy Transfer with Successor Features

Transfer source policies to a target reinforcement learning task with safety constraints using Successor Features.

Zeyu Feng
Zeyu Feng 21 Jan 2023
Embedding Symbolic Temporal Knowledge into Deep Sequential Models
learn knowledge ICRA

Embedding Symbolic Temporal Knowledge into Deep Sequential Models

We embed symbolic knowledge expressed as linear temporal logic (LTL) and use these embeddings to guide the training of deep sequential models.

Yaqi Xie
Yaqi Xie 05 Jun 2021
Learning Robust Latent Representation for Reinforcement Learning with Multi-Modal Observations
learn generative ICRA

Learning Robust Latent Representation for Reinforcement Learning with Multi-Modal Observations

We construct a shared latent space from different sensory modalities via contrastive learning.

Kaiqi Chen
Kaiqi Chen 28 Feb 2021
Enhancing Deep Learning with Symbolic Knowledge
learn ICRA

Enhancing Deep Learning with Symbolic Knowledge

Bridging the gap between symbolic and connectionist paradigms via Graph Neural Network embeddings

Yaqi Xie
Yaqi Xie 28 Feb 2021
Towards Effective Tactile Identification of Textures using a Hybrid Touch Approach
physical touch ICRA

Towards Effective Tactile Identification of Textures using a Hybrid Touch Approach

We show that iCub robot classifies the surface textures with both sliding and touch movements under loose constraints with high accuracy.

Tasbolat Taunyazov
Tasbolat Taunyazov 26 Jan 2019
1 Posts

IJRR

Multi-Task Trust in Human-Robot Interaction
social trust IJRR

Multi-Task Trust in Human-Robot Interaction

Human Trust in Robots across Task Contexts

Harold Soh
Harold Soh 01 Jan 2020
5 Posts

IROS

Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction
learn generative IROS

Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction

We construct a decomposed latent state space model for perspective-taking for human robot interaction.

Kaiqi Chen
Kaiqi Chen 24 Aug 2023
Refining 6-DoF Grasps with Context-Specific Classifiers
learn IROS

Refining 6-DoF Grasps with Context-Specific Classifiers

We propose a sampling-based grasp synthesis framework, GraspFlow, to generate context-specific grasps. We test GraspFlow in a real-world table-top grasping task.

Tasbolat Taunyazov
Tasbolat Taunyazov 20 Aug 2023
Extended Tactile Perception
physical touch IROS

Extended Tactile Perception

We show that robots can extend their perception through grasped tools/objects via dynamic tactile sensing.

Tasbolat Taunyazov
Tasbolat Taunyazov 27 Sep 2021
TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition
physical touch IROS

TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition

We propose a Spiking Graph Neural Network to take into account taxel geometry.

Fuqiang Gu
Fuqiang Gu 01 Jul 2020
Fast texture classification using tactile neural coding and spiking neural network
physical touch IROS

Fast texture classification using tactile neural coding and spiking neural network

We show that robots achieve fast classification of textures through Neural Encoding and Spiking Neural Network.

Tasbolat Taunyazov
Tasbolat Taunyazov 01 Jul 2020
4 Posts

NeurIPS

Out-of-Distribution Detection with a Single Unconditional Diffusion Model
generative NeurIPS learn

Out-of-Distribution Detection with a Single Unconditional Diffusion Model

We show that a single unconditional diffusion model performs competitively in out-of-distribution detection tasks by measuring the rate-of-change and curvature of diffusion paths connecting data samples to the standard normal distribution.

Alvin Heng
Alvin Heng 18 Oct 2024
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models
generative NeurIPS learn

Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models

We apply techniques from continual learning to the problem of selective forgetting in deep generative models. Our method, dubbed Selective Amnesia, allows users to remap undesired concepts to user-defined ones.

Alvin Heng
Alvin Heng 22 Sep 2023
Deep Explicit Duration Switching Models for Time Series
learn generative NeurIPS

Deep Explicit Duration Switching Models for Time Series

We propose a deep switching state space model that can capture both state-dependent and time-dependent switching patterns in time series data.

Abdul Fatir Ansari
Abdul Fatir Ansari 01 Dec 2021
Embedding Symbolic Knowledge into Deep Networks
learn knowledge NeurIPS

Embedding Symbolic Knowledge into Deep Networks

Leveraging prior symbolic knowledge to improve the performance of deep models.

Yaqi Xie
Yaqi Xie 08 Dec 2019
1 Posts

RA-L

LTLDoG: Satisfying Temporally-Extended Symbolic Constraints for Safe Diffusion-based Planning
learn generative RA-L

LTLDoG: Satisfying Temporally-Extended Symbolic Constraints for Safe Diffusion-based Planning

We develop a safe planning method for trajectory generation by sampling from diffusion model under different LTLf constraints.

Zeyu Feng
Zeyu Feng 21 Aug 2024
6 Posts

RSS

Octopi: Object Property Reasoning with Large Tactile-Language Models
learn touch RSS

Octopi: Object Property Reasoning with Large Tactile-Language Models

We introduce PhysiCLeaR, an annotated dataset of everyday objects and tactile readings collected from a Gelsight Mini sensor, as well as Octopi, a system that leverages both tactile representation learning and large vision-language models to perform physical reasoning and inference, given tactile videos of multiple objects.

CLeAR
CLeAR 14 May 2024
Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion
learn physical generative RSS

Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion

We develop interpolant policies that leverage informative source distributions for imitation learning.

Kaiqi Chen
Kaiqi Chen 14 May 2024
Arena 3.0 - Advancing Social Navigation in Collaborative and Highly Dynamic Environments
social navigation RSS

Arena 3.0 - Advancing Social Navigation in Collaborative and Highly Dynamic Environments

We introduce the third iteration of the Arena platform - Arena 3.0, a platform to develop, train, and benchmark social navigation approaches!

Linh Kästner
Linh Kästner 14 May 2024
GRaCE: Balancing Multiple Criteria to Achieve Stable, Collision-Free, and Functional Grasps
physical learn RSS

GRaCE: Balancing Multiple Criteria to Achieve Stable, Collision-Free, and Functional Grasps

We propose an optimization-based grasp synthesis framework, GRaCE, to generate context-specific grasps in complex scenarios. We test GRaCE in a simulator and a real-world grasping tasks.

Tasbolat Taunyazov
Tasbolat Taunyazov 14 May 2024
MIRROR for Assistive Human-Robot Communication
social learn trust RSS

MIRROR for Assistive Human-Robot Communication

Inspired by Social Projection Theory, we use the robot's self model to efficiently model humans.

Kaiqi Chen
Kaiqi Chen 13 Apr 2022
Event-Driven Visual-Tactile Sensing and Learning
physical touch RSS

Event-Driven Visual-Tactile Sensing and Learning

Accurate, Fast, and Low-powered Multi-Sensory Perception via Neuromorphic Sensing and Learning

Tasbolat Taunyazov
Tasbolat Taunyazov 30 Jan 2021
1 Posts

Social

Efficiently Exploring Reward Functions in Inverse RL
learn Social neurips

Efficiently Exploring Reward Functions in Inverse RL

Using Bayesian Optimization to address the ill-posed nature of Inverse Reinforcement Learning

Sreejith Balakrishnan
Sreejith Balakrishnan 30 Jun 2018
1 Posts

T-AFFC

Applying Probabilistic Programming to Affective Computing
social emotion T-AFFC

Applying Probabilistic Programming to Affective Computing

We propose a probabilistic programming approach to affective computing.

CLeAR
CLeAR 15 Mar 2019
6 Posts

award

Kaiqi wins the 2022 Research Achievement Award.
news award

Kaiqi wins the 2022 Research Achievement Award.

Kaiqi Chen is awarded the Research Achievement Award for his RSS 2022 paper on Differentiable Social Projection for Human Robot Communication.

CLeAR
CLeAR 29 Jul 2022
Harold wins NUS ATEA 2022.
news award

Harold wins NUS ATEA 2022.

Harold has been awarded the University Annual Teaching Excellence Award (2022). Harold also won the Faculty Teaching Excellence Award and is now on Faculty H...

CLeAR
CLeAR 26 Apr 2022
Sreejith wins the 2020 Research Achievement Award.
news award

Sreejith wins the 2020 Research Achievement Award.

Sreejith Balakrishnan is awarded the Research Achievement Award for his NeurIPS 2020 paper on efficiently exploring reward functions in Inverse Reinforcement...

CLeAR
CLeAR 25 Nov 2021
Tasbolat and team win IROS 2021 Best Paper Award.
news award touch

Tasbolat and team win IROS 2021 Best Paper Award.

We have won the Best Paper Award at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2021 in October. IROS is a premier flagshi...

CLeAR
CLeAR 17 Nov 2021
Yaqi wins the 2020 Research Achievement Award.
news award

Yaqi wins the 2020 Research Achievement Award.

Yaqi Xie is awarded the Research Achievement Award for his NeurIPS 2019 paper on Embedding symbolic knowledge into deep networks.

Yaqi Xie
Yaqi Xie 09 Jan 2020
Sreejith makes it to the 2019 Honor List of Student Tutors
news award

Sreejith makes it to the 2019 Honor List of Student Tutors

Sreejith Balakrishnan is awarded the 2019 Honor List of Student Tutors for his contribution as a tutor to the module “CS4246: AI Planning and Decision Making”.

CLeAR
CLeAR 10 Jan 2019
1 Posts

emotion

Applying Probabilistic Programming to Affective Computing
social emotion T-AFFC

Applying Probabilistic Programming to Affective Computing

We propose a probabilistic programming approach to affective computing.

CLeAR
CLeAR 15 Mar 2019
1 Posts

fairness

Fairness meets CMDPs
social fairness learn AIES

Fairness meets CMDPs

This paper proposes SCALES, a general framework that translates well-established fairness principles into a common representation based on CMDPs.

Sreejith Balakrishnan
Sreejith Balakrishnan 01 Aug 2022
11 Posts

generative

Out-of-Distribution Detection with a Single Unconditional Diffusion Model
generative NeurIPS learn

Out-of-Distribution Detection with a Single Unconditional Diffusion Model

We show that a single unconditional diffusion model performs competitively in out-of-distribution detection tasks by measuring the rate-of-change and curvature of diffusion paths connecting data samples to the standard normal distribution.

Alvin Heng
Alvin Heng 18 Oct 2024
LTLDoG: Satisfying Temporally-Extended Symbolic Constraints for Safe Diffusion-based Planning
learn generative RA-L

LTLDoG: Satisfying Temporally-Extended Symbolic Constraints for Safe Diffusion-based Planning

We develop a safe planning method for trajectory generation by sampling from diffusion model under different LTLf constraints.

Zeyu Feng
Zeyu Feng 21 Aug 2024
Generative Modeling with Flow-Guided Density Ratio Learning
generative learn

Generative Modeling with Flow-Guided Density Ratio Learning

We extend gradient flow methods to a variety of high-quality image synthesis tasks using a novel density ratio learning method.

Alvin Heng
Alvin Heng 01 Jun 2024
Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion
learn physical generative RSS

Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion

We develop interpolant policies that leverage informative source distributions for imitation learning.

Kaiqi Chen
Kaiqi Chen 14 May 2024
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models
generative NeurIPS learn

Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models

We apply techniques from continual learning to the problem of selective forgetting in deep generative models. Our method, dubbed Selective Amnesia, allows users to remap undesired concepts to user-defined ones.

Alvin Heng
Alvin Heng 22 Sep 2023
Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction
learn generative IROS

Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction

We construct a decomposed latent state space model for perspective-taking for human robot interaction.

Kaiqi Chen
Kaiqi Chen 24 Aug 2023
Deep Explicit Duration Switching Models for Time Series
learn generative NeurIPS

Deep Explicit Duration Switching Models for Time Series

We propose a deep switching state space model that can capture both state-dependent and time-dependent switching patterns in time series data.

Abdul Fatir Ansari
Abdul Fatir Ansari 01 Dec 2021
Learning Robust Latent Representation for Reinforcement Learning with Multi-Modal Observations
learn generative ICRA

Learning Robust Latent Representation for Reinforcement Learning with Multi-Modal Observations

We construct a shared latent space from different sensory modalities via contrastive learning.

Kaiqi Chen
Kaiqi Chen 28 Feb 2021
Discriminator Gradient Flow
generative learn ICLR

Discriminator Gradient Flow

Using Gradient Flows to Refine Samples from Deep Generative Models

Abdul Fatir Ansari
Abdul Fatir Ansari 12 Feb 2021
A characteristic function approach to deep implicit generative modeling
learn generative CVPR

A characteristic function approach to deep implicit generative modeling

We present a new method for training GANs via characteristic functions

Abdul Fatir Ansari
Abdul Fatir Ansari 14 Jun 2020
Generation meets recommendation: proposing novel items for groups of users
learn generative

Generation meets recommendation: proposing novel items for groups of users

We present an approach to generate new items for groups of users based on their interaction history.

CLeAR
CLeAR 27 Sep 2018
1 Posts

icra

Harold delivers ICRA'24 Keynote
news icra

Harold delivers ICRA'24 Keynote

Harold gave a well-received Keynote at ICRA’24 on our group’s work on generative modeling and robotics! He spoke about two of our recent works on new kinds o...

CLeAR
CLeAR 15 May 2024
2 Posts

knowledge

Embedding Symbolic Temporal Knowledge into Deep Sequential Models
learn knowledge ICRA

Embedding Symbolic Temporal Knowledge into Deep Sequential Models

We embed symbolic knowledge expressed as linear temporal logic (LTL) and use these embeddings to guide the training of deep sequential models.

Yaqi Xie
Yaqi Xie 05 Jun 2021
Embedding Symbolic Knowledge into Deep Networks
learn knowledge NeurIPS

Embedding Symbolic Knowledge into Deep Networks

Leveraging prior symbolic knowledge to improve the performance of deep models.

Yaqi Xie
Yaqi Xie 08 Dec 2019
29 Posts

learn

Out-of-Distribution Detection with a Single Unconditional Diffusion Model
generative NeurIPS learn

Out-of-Distribution Detection with a Single Unconditional Diffusion Model

We show that a single unconditional diffusion model performs competitively in out-of-distribution detection tasks by measuring the rate-of-change and curvature of diffusion paths connecting data samples to the standard normal distribution.

Alvin Heng
Alvin Heng 18 Oct 2024
LTLDoG: Satisfying Temporally-Extended Symbolic Constraints for Safe Diffusion-based Planning
learn generative RA-L

LTLDoG: Satisfying Temporally-Extended Symbolic Constraints for Safe Diffusion-based Planning

We develop a safe planning method for trajectory generation by sampling from diffusion model under different LTLf constraints.

Zeyu Feng
Zeyu Feng 21 Aug 2024
Generative Modeling with Flow-Guided Density Ratio Learning
generative learn

Generative Modeling with Flow-Guided Density Ratio Learning

We extend gradient flow methods to a variety of high-quality image synthesis tasks using a novel density ratio learning method.

Alvin Heng
Alvin Heng 01 Jun 2024
Octopi: Object Property Reasoning with Large Tactile-Language Models
learn touch RSS

Octopi: Object Property Reasoning with Large Tactile-Language Models

We introduce PhysiCLeaR, an annotated dataset of everyday objects and tactile readings collected from a Gelsight Mini sensor, as well as Octopi, a system that leverages both tactile representation learning and large vision-language models to perform physical reasoning and inference, given tactile videos of multiple objects.

CLeAR
CLeAR 14 May 2024
Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion
learn physical generative RSS

Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion

We develop interpolant policies that leverage informative source distributions for imitation learning.

Kaiqi Chen
Kaiqi Chen 14 May 2024
GRaCE: Balancing Multiple Criteria to Achieve Stable, Collision-Free, and Functional Grasps
physical learn RSS

GRaCE: Balancing Multiple Criteria to Achieve Stable, Collision-Free, and Functional Grasps

We propose an optimization-based grasp synthesis framework, GRaCE, to generate context-specific grasps in complex scenarios. We test GRaCE in a simulator and a real-world grasping tasks.

Tasbolat Taunyazov
Tasbolat Taunyazov 14 May 2024
Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation
learn navigation ICRA

Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation

We introduce a novel framework centered around the Probable Object Location (POLo) score, which allows the agent to make data-driven decisions for efficient object search.

Jiaming Wang
Jiaming Wang 19 Apr 2024
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models
generative NeurIPS learn

Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models

We apply techniques from continual learning to the problem of selective forgetting in deep generative models. Our method, dubbed Selective Amnesia, allows users to remap undesired concepts to user-defined ones.

Alvin Heng
Alvin Heng 22 Sep 2023
The Best of Both Worlds in Network Population Games: Reaching Consensus and Convergence to Equilibrium
learn

The Best of Both Worlds in Network Population Games: Reaching Consensus and Convergence to Equilibrium

We study a model of multi-population learning with heterogenous beliefs.

Shuyue Hu
Shuyue Hu 22 Sep 2023
Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction
learn generative IROS

Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction

We construct a decomposed latent state space model for perspective-taking for human robot interaction.

Kaiqi Chen
Kaiqi Chen 24 Aug 2023
Large Language Models as Zero-Shot Human Models for Human-Robot Interaction
social learn trust

Large Language Models as Zero-Shot Human Models for Human-Robot Interaction

We explore the potential of LLMs to act as zero-shot human models for HRI. We contribute an empirical study and case studies on a simulated table-clearing task and a new robot utensil-passing experiment.

Bowen Zhang
Bowen Zhang 24 Aug 2023
Refining 6-DoF Grasps with Context-Specific Classifiers
learn IROS

Refining 6-DoF Grasps with Context-Specific Classifiers

We propose a sampling-based grasp synthesis framework, GraspFlow, to generate context-specific grasps. We test GraspFlow in a real-world table-top grasping task.

Tasbolat Taunyazov
Tasbolat Taunyazov 20 Aug 2023
Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series
learn ICML

Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series

We develop a family of stable continuous-time neural state space-models.

Abdul Fatir Ansari
Abdul Fatir Ansari 24 Apr 2023
Translating Natural Language to Planning Goals with Large-Language Models
learn social

Translating Natural Language to Planning Goals with Large-Language Models

We contribute an empirical study into the effectiveness of LLMs, specifically GPT-3.5 variants, for the task of natural language goal translation to PDDL.

CLeAR
CLeAR 26 Jan 2023
Safety-Constrained Policy Transfer with Successor Features
learn ICRA

Safety-Constrained Policy Transfer with Successor Features

Transfer source policies to a target reinforcement learning task with safety constraints using Successor Features.

Zeyu Feng
Zeyu Feng 21 Jan 2023
Observed Adversaries in Deep Reinforcement Learning
learn AI-HRI

Observed Adversaries in Deep Reinforcement Learning

We examine the problem of observed adversaries for deep policies, where observations of other agents can hamper robot performance.

Eugene Lim
Eugene Lim 13 Oct 2022
Fairness meets CMDPs
social fairness learn AIES

Fairness meets CMDPs

This paper proposes SCALES, a general framework that translates well-established fairness principles into a common representation based on CMDPs.

Sreejith Balakrishnan
Sreejith Balakrishnan 01 Aug 2022
The Dynamics of Q-learning in Population Games
social learn AAMAS

The Dynamics of Q-learning in Population Games

We develop an accurate physics-inspired model for describing how a population of Q-learning agents adapt as they interact.

CLeAR
CLeAR 09 May 2022
MIRROR for Assistive Human-Robot Communication
social learn trust RSS

MIRROR for Assistive Human-Robot Communication

Inspired by Social Projection Theory, we use the robot's self model to efficiently model humans.

Kaiqi Chen
Kaiqi Chen 13 Apr 2022
Deep Explicit Duration Switching Models for Time Series
learn generative NeurIPS

Deep Explicit Duration Switching Models for Time Series

We propose a deep switching state space model that can capture both state-dependent and time-dependent switching patterns in time series data.

Abdul Fatir Ansari
Abdul Fatir Ansari 01 Dec 2021
Embedding Symbolic Temporal Knowledge into Deep Sequential Models
learn knowledge ICRA

Embedding Symbolic Temporal Knowledge into Deep Sequential Models

We embed symbolic knowledge expressed as linear temporal logic (LTL) and use these embeddings to guide the training of deep sequential models.

Yaqi Xie
Yaqi Xie 05 Jun 2021
Learning Robust Latent Representation for Reinforcement Learning with Multi-Modal Observations
learn generative ICRA

Learning Robust Latent Representation for Reinforcement Learning with Multi-Modal Observations

We construct a shared latent space from different sensory modalities via contrastive learning.

Kaiqi Chen
Kaiqi Chen 28 Feb 2021
Enhancing Deep Learning with Symbolic Knowledge
learn ICRA

Enhancing Deep Learning with Symbolic Knowledge

Bridging the gap between symbolic and connectionist paradigms via Graph Neural Network embeddings

Yaqi Xie
Yaqi Xie 28 Feb 2021
Discriminator Gradient Flow
generative learn ICLR

Discriminator Gradient Flow

Using Gradient Flows to Refine Samples from Deep Generative Models

Abdul Fatir Ansari
Abdul Fatir Ansari 12 Feb 2021
A characteristic function approach to deep implicit generative modeling
learn generative CVPR

A characteristic function approach to deep implicit generative modeling

We present a new method for training GANs via characteristic functions

Abdul Fatir Ansari
Abdul Fatir Ansari 14 Jun 2020
Juiced and Ready to Predict Private Information in Deep Cooperative Reinforcement Learning
learn HRI

Juiced and Ready to Predict Private Information in Deep Cooperative Reinforcement Learning

Training robots that can interactively assist humans with private information

Eugene Lim
Eugene Lim 01 Mar 2020
Embedding Symbolic Knowledge into Deep Networks
learn knowledge NeurIPS

Embedding Symbolic Knowledge into Deep Networks

Leveraging prior symbolic knowledge to improve the performance of deep models.

Yaqi Xie
Yaqi Xie 08 Dec 2019
Generation meets recommendation: proposing novel items for groups of users
learn generative

Generation meets recommendation: proposing novel items for groups of users

We present an approach to generate new items for groups of users based on their interaction history.

CLeAR
CLeAR 27 Sep 2018
Efficiently Exploring Reward Functions in Inverse RL
learn Social neurips

Efficiently Exploring Reward Functions in Inverse RL

Using Bayesian Optimization to address the ill-posed nature of Inverse Reinforcement Learning

Sreejith Balakrishnan
Sreejith Balakrishnan 30 Jun 2018
2 Posts

navigation

Arena 3.0 - Advancing Social Navigation in Collaborative and Highly Dynamic Environments
social navigation RSS

Arena 3.0 - Advancing Social Navigation in Collaborative and Highly Dynamic Environments

We introduce the third iteration of the Arena platform - Arena 3.0, a platform to develop, train, and benchmark social navigation approaches!

Linh Kästner
Linh Kästner 14 May 2024
Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation
learn navigation ICRA

Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation

We introduce a novel framework centered around the Probable Object Location (POLo) score, which allows the agent to make data-driven decisions for efficient object search.

Jiaming Wang
Jiaming Wang 19 Apr 2024
1 Posts

neurips

Efficiently Exploring Reward Functions in Inverse RL
learn Social neurips

Efficiently Exploring Reward Functions in Inverse RL

Using Bayesian Optimization to address the ill-posed nature of Inverse Reinforcement Learning

Sreejith Balakrishnan
Sreejith Balakrishnan 30 Jun 2018
19 Posts

news

Harold delivers ICRA'24 Keynote
news icra

Harold delivers ICRA'24 Keynote

Harold gave a well-received Keynote at ICRA’24 on our group’s work on generative modeling and robotics! He spoke about two of our recent works on new kinds o...

CLeAR
CLeAR 15 May 2024
4 Papers at R:SS'24.
news

4 Papers at R:SS'24.

All four of our submissions (3 papers, 1 demo) were accepted to R:SS 2024! A fantastic accomplishment by our CLeAR members Kaiqi, Samson, Tasbolat, Linh, Kel...

CLeAR
CLeAR 14 May 2024
2 Papers at Neurips'23.
news

2 Papers at Neurips'23.

Both our submitted papers were accepted to Neurips this year! Come join us in New Orleans! Congrats to Alvin and Shuyue. Find out more about the papers below...

CLeAR
CLeAR 22 Sep 2023
3 Papers at IROS'23.
news

3 Papers at IROS'23.

CLeAR had three papers accepted to IROS this year! Come join us in Detroit! Congrats to Tasbolat, Bowen, and Kaiqi. Find out more about the papers below: ...

CLeAR
CLeAR 30 Aug 2023
Introducing Dr. Sreejith Balakrishnan!
news

Introducing Dr. Sreejith Balakrishnan!

Congratulations Sreejith on successfully defending his thesis! Sreejith’s work was on value alignment in human-centric AI/robots. Check out his Neurips pap...

CLeAR
CLeAR 04 Jul 2023
Early Career Spotlight at R:SS 2023!
news

Early Career Spotlight at R:SS 2023!

Harold has been awarded an Early Career Spotlight at the Robotics: Science and Systems 2023. The Early Career Spotlight “* acknowledges the outstanding acc...

CLeAR
CLeAR 02 Jul 2023
Introducing Dr. Xie Yaqi.
news

Introducing Dr. Xie Yaqi.

Xie Yaqi successfully defended her thesis and is now Dr. Xie. Congratulations Yaqi! You can find out more about Yaqi’s work on embedding symbolic knowledg...

CLeAR
CLeAR 02 Feb 2023
IEEE T-AFFC Best Paper Award!
news

IEEE T-AFFC Best Paper Award!

Our joint work with Desmond Ong, Jamil Zaki and Noah Goodman on Applying Probabilistic Programming to Affective Computing is one of 5 Best Papers (out of 82 ...

CLeAR
CLeAR 10 Sep 2022
Kaiqi wins the 2022 Research Achievement Award.
news award

Kaiqi wins the 2022 Research Achievement Award.

Kaiqi Chen is awarded the Research Achievement Award for his RSS 2022 paper on Differentiable Social Projection for Human Robot Communication.

CLeAR
CLeAR 29 Jul 2022
Harold wins NUS ATEA 2022.
news award

Harold wins NUS ATEA 2022.

Harold has been awarded the University Annual Teaching Excellence Award (2022). Harold also won the Faculty Teaching Excellence Award and is now on Faculty H...

CLeAR
CLeAR 26 Apr 2022
CLeAR graduates its first PhD Student.
news

CLeAR graduates its first PhD Student.

Abdul Fatir Ansari successfully defended his thesis and is now Dr. Ansari. Congratulations Fatir!

CLeAR
CLeAR 25 Nov 2021
Sreejith wins the 2020 Research Achievement Award.
news award

Sreejith wins the 2020 Research Achievement Award.

Sreejith Balakrishnan is awarded the Research Achievement Award for his NeurIPS 2020 paper on efficiently exploring reward functions in Inverse Reinforcement...

CLeAR
CLeAR 25 Nov 2021
Tasbolat and team win IROS 2021 Best Paper Award.
news award touch

Tasbolat and team win IROS 2021 Best Paper Award.

We have won the Best Paper Award at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2021 in October. IROS is a premier flagshi...

CLeAR
CLeAR 17 Nov 2021
Harold wins Annual University and Faculty Teaching Awards!
news

Harold wins Annual University and Faculty Teaching Awards!

Harold was awarded the university level and faculty teaching awards for the year 20/21!

CLeAR
CLeAR 01 Mar 2021
Harold wins faculty teaching award for the 3rd time!
news

Harold wins faculty teaching award for the 3rd time!

Harold was awarded the faculty teaching award for the year 19/20!

CLeAR
CLeAR 07 Mar 2020
Yaqi wins the 2020 Research Achievement Award.
news award

Yaqi wins the 2020 Research Achievement Award.

Yaqi Xie is awarded the Research Achievement Award for his NeurIPS 2019 paper on Embedding symbolic knowledge into deep networks.

Yaqi Xie
Yaqi Xie 09 Jan 2020
Harold wins Faculty Teaching Award!
news

Harold wins Faculty Teaching Award!

Harold was awarded the faculty teaching award for the year 18/19!

CLeAR
CLeAR 01 Mar 2019
Sreejith makes it to the 2019 Honor List of Student Tutors
news award

Sreejith makes it to the 2019 Honor List of Student Tutors

Sreejith Balakrishnan is awarded the 2019 Honor List of Student Tutors for his contribution as a tutor to the module “CS4246: AI Planning and Decision Making”.

CLeAR
CLeAR 10 Jan 2019
Harold wins Faculty Teaching Award 17/18!
news

Harold wins Faculty Teaching Award 17/18!

Harold was awarded the faculty teaching award for the year 17/18! A first time win.

CLeAR
CLeAR 01 Mar 2018
7 Posts

physical

Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion
learn physical generative RSS

Don’t Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion

We develop interpolant policies that leverage informative source distributions for imitation learning.

Kaiqi Chen
Kaiqi Chen 14 May 2024
GRaCE: Balancing Multiple Criteria to Achieve Stable, Collision-Free, and Functional Grasps
physical learn RSS

GRaCE: Balancing Multiple Criteria to Achieve Stable, Collision-Free, and Functional Grasps

We propose an optimization-based grasp synthesis framework, GRaCE, to generate context-specific grasps in complex scenarios. We test GRaCE in a simulator and a real-world grasping tasks.

Tasbolat Taunyazov
Tasbolat Taunyazov 14 May 2024
Extended Tactile Perception
physical touch IROS

Extended Tactile Perception

We show that robots can extend their perception through grasped tools/objects via dynamic tactile sensing.

Tasbolat Taunyazov
Tasbolat Taunyazov 27 Sep 2021
Event-Driven Visual-Tactile Sensing and Learning
physical touch RSS

Event-Driven Visual-Tactile Sensing and Learning

Accurate, Fast, and Low-powered Multi-Sensory Perception via Neuromorphic Sensing and Learning

Tasbolat Taunyazov
Tasbolat Taunyazov 30 Jan 2021
TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition
physical touch IROS

TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition

We propose a Spiking Graph Neural Network to take into account taxel geometry.

Fuqiang Gu
Fuqiang Gu 01 Jul 2020
Fast texture classification using tactile neural coding and spiking neural network
physical touch IROS

Fast texture classification using tactile neural coding and spiking neural network

We show that robots achieve fast classification of textures through Neural Encoding and Spiking Neural Network.

Tasbolat Taunyazov
Tasbolat Taunyazov 01 Jul 2020
Towards Effective Tactile Identification of Textures using a Hybrid Touch Approach
physical touch ICRA

Towards Effective Tactile Identification of Textures using a Hybrid Touch Approach

We show that iCub robot classifies the surface textures with both sliding and touch movements under loose constraints with high accuracy.

Tasbolat Taunyazov
Tasbolat Taunyazov 26 Jan 2019
1 Posts

simulation

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms
social simulation Arxiv

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms

We design an LLM-driven social-scenario simulation pipeline (SocRATES) to enable more holistic evaluation of social navigation algorithms. SocRATES generates context- and location-appropriate scenarios from simple text and image-based inputs, thus reducing the labor-intensive task of scenario proposal and synthesis that is typically required for scenario-based testing.

Shashank Rao Marpally
Shashank Rao Marpally 30 Dec 2024
13 Posts

social

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms
social simulation Arxiv

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms

We design an LLM-driven social-scenario simulation pipeline (SocRATES) to enable more holistic evaluation of social navigation algorithms. SocRATES generates context- and location-appropriate scenarios from simple text and image-based inputs, thus reducing the labor-intensive task of scenario proposal and synthesis that is typically required for scenario-based testing.

Shashank Rao Marpally
Shashank Rao Marpally 30 Dec 2024
Arena 3.0 - Advancing Social Navigation in Collaborative and Highly Dynamic Environments
social navigation RSS

Arena 3.0 - Advancing Social Navigation in Collaborative and Highly Dynamic Environments

We introduce the third iteration of the Arena platform - Arena 3.0, a platform to develop, train, and benchmark social navigation approaches!

Linh Kästner
Linh Kästner 14 May 2024
Large Language Models as Zero-Shot Human Models for Human-Robot Interaction
social learn trust

Large Language Models as Zero-Shot Human Models for Human-Robot Interaction

We explore the potential of LLMs to act as zero-shot human models for HRI. We contribute an empirical study and case studies on a simulated table-clearing task and a new robot utensil-passing experiment.

Bowen Zhang
Bowen Zhang 24 Aug 2023
Translating Natural Language to Planning Goals with Large-Language Models
learn social

Translating Natural Language to Planning Goals with Large-Language Models

We contribute an empirical study into the effectiveness of LLMs, specifically GPT-3.5 variants, for the task of natural language goal translation to PDDL.

CLeAR
CLeAR 26 Jan 2023
Fairness meets CMDPs
social fairness learn AIES

Fairness meets CMDPs

This paper proposes SCALES, a general framework that translates well-established fairness principles into a common representation based on CMDPs.

Sreejith Balakrishnan
Sreejith Balakrishnan 01 Aug 2022
The Dynamics of Q-learning in Population Games
social learn AAMAS

The Dynamics of Q-learning in Population Games

We develop an accurate physics-inspired model for describing how a population of Q-learning agents adapt as they interact.

CLeAR
CLeAR 09 May 2022
MIRROR for Assistive Human-Robot Communication
social learn trust RSS

MIRROR for Assistive Human-Robot Communication

Inspired by Social Projection Theory, we use the robot's self model to efficiently model humans.

Kaiqi Chen
Kaiqi Chen 13 Apr 2022
Getting to Know One Another Calibrating Intent, Capabilities and Trust for Human-Robot Collaboration
social trust HRI

Getting to Know One Another Calibrating Intent, Capabilities and Trust for Human-Robot Collaboration

We address the problem of intention and capability calibration in human-robot collaboration with a decision-theoretic approach.

Joshua Lee
Joshua Lee 24 Oct 2020
Modeling the Interplay of Trust and Attention in HRI an Autonomous Vehicle Study
social trust HRI

Modeling the Interplay of Trust and Attention in HRI an Autonomous Vehicle Study

We study and model how trust and attention affect how humans interact with autonomous vehicles.

CLeAR
CLeAR 23 Mar 2020
Multi-Task Trust in Human-Robot Interaction
social trust IJRR

Multi-Task Trust in Human-Robot Interaction

Human Trust in Robots across Task Contexts

Harold Soh
Harold Soh 01 Jan 2020
Applying Probabilistic Programming to Affective Computing
social emotion T-AFFC

Applying Probabilistic Programming to Affective Computing

We propose a probabilistic programming approach to affective computing.

CLeAR
CLeAR 15 Mar 2019
Robot Capability and Intention in Trust-based Decisions across Tasks
social trust HRI

Robot Capability and Intention in Trust-based Decisions across Tasks

We present results from a human-subject study designed to explore two facets of human mental models of robots - inferred capability and intention - and their relationship to overall trust and eventual decisions.

Yaqi Xie
Yaqi Xie 11 Mar 2019
Planning with Trust for Human-Robot Collaboration
social trust HRI

Planning with Trust for Human-Robot Collaboration

Robot decision-making with Human Trust.

Harold Soh
Harold Soh 01 Mar 2018
7 Posts

touch

Octopi: Object Property Reasoning with Large Tactile-Language Models
learn touch RSS

Octopi: Object Property Reasoning with Large Tactile-Language Models

We introduce PhysiCLeaR, an annotated dataset of everyday objects and tactile readings collected from a Gelsight Mini sensor, as well as Octopi, a system that leverages both tactile representation learning and large vision-language models to perform physical reasoning and inference, given tactile videos of multiple objects.

CLeAR
CLeAR 14 May 2024
Tasbolat and team win IROS 2021 Best Paper Award.
news award touch

Tasbolat and team win IROS 2021 Best Paper Award.

We have won the Best Paper Award at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2021 in October. IROS is a premier flagshi...

CLeAR
CLeAR 17 Nov 2021
Extended Tactile Perception
physical touch IROS

Extended Tactile Perception

We show that robots can extend their perception through grasped tools/objects via dynamic tactile sensing.

Tasbolat Taunyazov
Tasbolat Taunyazov 27 Sep 2021
Event-Driven Visual-Tactile Sensing and Learning
physical touch RSS

Event-Driven Visual-Tactile Sensing and Learning

Accurate, Fast, and Low-powered Multi-Sensory Perception via Neuromorphic Sensing and Learning

Tasbolat Taunyazov
Tasbolat Taunyazov 30 Jan 2021
TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition
physical touch IROS

TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition

We propose a Spiking Graph Neural Network to take into account taxel geometry.

Fuqiang Gu
Fuqiang Gu 01 Jul 2020
Fast texture classification using tactile neural coding and spiking neural network
physical touch IROS

Fast texture classification using tactile neural coding and spiking neural network

We show that robots achieve fast classification of textures through Neural Encoding and Spiking Neural Network.

Tasbolat Taunyazov
Tasbolat Taunyazov 01 Jul 2020
Towards Effective Tactile Identification of Textures using a Hybrid Touch Approach
physical touch ICRA

Towards Effective Tactile Identification of Textures using a Hybrid Touch Approach

We show that iCub robot classifies the surface textures with both sliding and touch movements under loose constraints with high accuracy.

Tasbolat Taunyazov
Tasbolat Taunyazov 26 Jan 2019
8 Posts

trust

Large Language Models as Zero-Shot Human Models for Human-Robot Interaction
social learn trust

Large Language Models as Zero-Shot Human Models for Human-Robot Interaction

We explore the potential of LLMs to act as zero-shot human models for HRI. We contribute an empirical study and case studies on a simulated table-clearing task and a new robot utensil-passing experiment.

Bowen Zhang
Bowen Zhang 24 Aug 2023
MIRROR for Assistive Human-Robot Communication
social learn trust RSS

MIRROR for Assistive Human-Robot Communication

Inspired by Social Projection Theory, we use the robot's self model to efficiently model humans.

Kaiqi Chen
Kaiqi Chen 13 Apr 2022
Trust in Robots: Challenges and Opportunities
trust

Trust in Robots: Challenges and Opportunities

We examine how recent advances in psychometrics, trustworthy systems, deep learning etc. can help address challenges that arise with respect to trust in real-world human robot interactions.

Harold Soh
Harold Soh 01 Dec 2020
Getting to Know One Another Calibrating Intent, Capabilities and Trust for Human-Robot Collaboration
social trust HRI

Getting to Know One Another Calibrating Intent, Capabilities and Trust for Human-Robot Collaboration

We address the problem of intention and capability calibration in human-robot collaboration with a decision-theoretic approach.

Joshua Lee
Joshua Lee 24 Oct 2020
Modeling the Interplay of Trust and Attention in HRI an Autonomous Vehicle Study
social trust HRI

Modeling the Interplay of Trust and Attention in HRI an Autonomous Vehicle Study

We study and model how trust and attention affect how humans interact with autonomous vehicles.

CLeAR
CLeAR 23 Mar 2020
Multi-Task Trust in Human-Robot Interaction
social trust IJRR

Multi-Task Trust in Human-Robot Interaction

Human Trust in Robots across Task Contexts

Harold Soh
Harold Soh 01 Jan 2020
Robot Capability and Intention in Trust-based Decisions across Tasks
social trust HRI

Robot Capability and Intention in Trust-based Decisions across Tasks

We present results from a human-subject study designed to explore two facets of human mental models of robots - inferred capability and intention - and their relationship to overall trust and eventual decisions.

Yaqi Xie
Yaqi Xie 11 Mar 2019
Planning with Trust for Human-Robot Collaboration
social trust HRI

Planning with Trust for Human-Robot Collaboration

Robot decision-making with Human Trust.

Harold Soh
Harold Soh 01 Mar 2018

CLeAR

Collaborative, Learning, and Adaptive Robots Lab @ NUS.

Recent posts

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms
social simulation Arxiv

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms

Shashank Rao Marpally
Shashank Rao Marpally 30 Dec 2024
Out-of-Distribution Detection with a Single Unconditional Diffusion Model
generative NeurIPS learn

Out-of-Distribution Detection with a Single Unconditional Diffusion Model

Alvin Heng
Alvin Heng 18 Oct 2024

Menu

  • Home
  • People
  • Publications
  • Software & Data
  • About
2025 © CLeAR. Developed by the CLeAR team using the Mria theme.