Feedback Approach to Foster Motion Information in FPAR
Summary
- Improved the existing SparNet architecture by encorporating a feedback mechanism which basically embeds the finer information from the later layers of Resnet in it’s earlier layers.
- The Motion Prediction Block used the knowledge from the Action Recognition Block to incorporate it back into that in it’s first layer while taking care of the dimensions.
- Deployed the model on a webpage using flask framework where an user can input a video or an image and gets returned a heat map indicating the location of the action.