Hi there, I’m Rashmeet!
I’m a Ph.D. candidate in Computer Science at Arizona State University, where I work with Dr. Siddharth Srivastava in the School of Computing and Augmented Intelligence. I’m part of the Autonomous Agents and Intelligent Robots (AAIR) research group. My research primarily centers on Reinforcement Learning (RL), with a focus on developing more sample-efficient and scalable autonomous sequential decision-making systems, particularly for long-horizon tasks. Currently, I am investigating the autonomous invention of temporal and state abstractions and the integration of planning with RL to improve generalization and transfer in RL.
Interests
- Reinforcement Learning and Planning
- Learning Abstractions
- Generalization and Transfer
- Robotics
Education
Ph.D. in Computer Science, 2020 - present
Arizona State University
M.S. in Computer Science, 2018 - 2020
Arizona State University
B.E. in Information Technology, 2013 - 2017
Pune Institute of Computer Technology
Publications
Autonomous Option Invention for Continual Hierarchical Reinforcement Learning and Planning
Using Explainable AI and Hierarchical Planning for Outreach with Robots
Conditional Abstraction Trees for Sample-efficient Reinforcement Learning
Learning Generalized Policy Automata for Relational Stochastic Shortest Path Problems
Awards & Press
Chambliss Astronomy Achievement Student Award
American Astronomical Society awards ASU students Chambliss medals
Rashmeet Kaur Nayyar receives Chambliss medal from American Astronomical Society
Projects
Perfect Observability is a Myth - Restraining Bolts in the Real World
Developed a framework for imposing constraints on an AI agent in a world with nosiy observations. poster attached
Card Shuffling using Markov chains
Evaluated overhand, top-to-random, Knuth, transposition, thorp, and riffle card shuffling techniques. presentation attached
Vision-based Manipulator movement with Fetch
Implemented a visual-feedback based method to guide the Fetch mobile manipulator’s end-effector to reach the target object without using AR-markers. video attached
Higgs Boson Particle discovery
Performed exploratory data analysis, and compared classification of ATLAS experiment events using advanced machine learning techniques such as XGBoost and neural networks.
AI Pacman Agent
Comprehensive implementation of AI methods such as DFS, BFS, UCS, A* search, minimax, expectimax, and alpha-beta pruning to create Pacman in a multi-agent environment using Python.
Denoising and Stacked Autoencoders
Built & evaluated denoising capabilities of a denoising autoencoder with different levels of noise. Trained a stacked autoencoder layer-by-layer in an unsupervised fashion, & fine-tuned the network with the classifier.