Research

Experimentation, design, and prototype of a system to increase insight into reinforcement learning algorithms and agent policies through interactive visualizations. Discussion of a related research investigation to increase insight into the learning dynamics of actor-critic learning algorithms by visualizing optimization landscapes.

Design and implementation of an interactive visualization tool for debugging and interpreting reinforcement learning algorithms.

Prototype of a visualization tool for reinforcement learning researchers to interpret, introspect, and gain intuition for the successes and failures of trained policies.

Designed neural network architectures to emulate differential equation solvers. Primary motivation was to help better understand climate change effects on coral reefs. Work led to 10x improvement over previous known solution.

Demonstrated that nonparametric function approximation with neural networks can replicate radiative transfer calculations, generate accurate radiance spectra at multiple wavelengths over a diverse range of surface and atmosphere state parameters, and can act as surrogate forward models for atmospheric correction procedures. Evaluated the approach in atmospheric correction of data from the PRISM airborne imaging spectrometer.

Built a compute cluster and data science pipeline to synthesize images from a radio telescope. Effort reduced synthesis time from 6+ weeks to 10-12 hours. Project is currently generating one of the world's largest catalogs of sub-GHz frequency radio astronomy images.

Explored the use of streaming algorithms to monitor data center network traffic. Potential future tech transfer to Microsoft Azure.

Worked on optimizing a VR rendering pipeline for mobile devices. Broader effort was to preserve heritage monuments through 3D laser scans. Got to present to the Secretary of Science and Technology (Govt. of India), and Secretary for Ministry of Culture :)