Feedback Approach to Foster Motion Information in FPAR

Summary

  • Improved the existing SparNet architecture by encorporating a feedback mechanism which basically embeds the finer information from the later layers of Resnet in it’s earlier layers.
  • The Motion Prediction Block used the knowledge from the Action Recognition Block to incorporate it back into that in it’s first layer while taking care of the dimensions.
  • Deployed the model on a webpage using flask framework where an user can input a video or an image and gets returned a heat map indicating the location of the action.
Susim Mukul Roy
Susim Mukul Roy
MS Student

My main goal is to build trustable ai integrated robotic systems.