Grasp-O-Matic

RGB-D 6D Grasp Pose for Unknown Objects

SAM 2 Foundation Models Grasp Net

Overview

This project seeks to explore a pipeline for general manipulation. The goal of this project is to provide a pipeline that enables a 6DOF robot with parallel end effector to grasp general objects as prompted by a user. To accomplish this we use a combination of prompt based foundation models and point cloud processing to generate optimal grasp poses. We use Grounding Dino for prompt based object bounding which is followed by SAM 2 for segmentation masking of the desired object and lastly we apply NVIDIA Contact GraspNet for grasp pose generation.


Problem Statement