Puneet Kumar

I am a Ph.D. student at Machine Intelligence Lab, Indian Institute of Technology Roorkee, India, advised by Prof. R. Balasubramanian. My research interest includes Multimodal Emotion Analysis using Image, Text and Speech data.

I studied B.E. (Computer Science) from Manipal University, Karnataka, India and M.E. (Computer Science) from Thapar University, Punjab, India. I have worked at Oracle IDC Hyderabad as Software Engineer, Samsung R&D as Visiting Researcher and Osaka Prefecture University as Visiting Researcher. My detailed resume can be found below. Personal info about me: puneetkumar.com

Picture

News


  1. Aug 2022: Submitted Ph.D. Thesis entitled 'Multimodal Emotion Analysis Using Deep Learning Techniques' on 01 Aug 2022.
  2. July 2022: A paper titled 'Zero-shot Learning based Cross-lingual Sentiment Analysis for Sanskrit Text with Insufficient Labeled Data' got accepted in Springer Applied Intelligence (APIN) Journal.
  3. June 2022: A paper titled 'Automatic Evaluation of Machine Generated Feedback For Text and Image Data' got accepted in IEEE 5th International Conference on Multimedia Information Processing and Retrieval Workshop on Multimedia Computing for Automated Urban Intelligent Systems (MIPRw 2022).
  4. Mar 2022: A paper titled 'A BERT Based Dual-Channel Explainable Text Emotion Recognition System' got accepted in Elsevier Neural Networks (NeuNet) Journal.
  5. Sep 2021: A paper titled 'Towards Interpretable Facial Emotion Recognition' got accepted in The 12th Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP 2021), Jodhpur, India.
  6. Aug 2021: A copyright titled 'Deep Neural Network Explainability Technique with Application in Multimodal Emotion Recognition' got registered (Certificate No. L-106713/2021).
  7. June 2021: A paper titled 'Towards the explainability of Multimodal Speech Emotion Recognition' got accepted in The 22nd Annual Conference of the International Speech Communication Association (InterSpeech 2021), Brno, Czech Republic.
  8. June 2021: Filed a copyright titled 'Deep Neural Network Explainability Technique with Application in Multimodal Emotion Recognition'.
  9. May 2021: A paper titled 'Hybrid Fusion Based Approach for Multimodal Emotion Recognition with Insufficient Labelled Data' got accepted in The 28th International Conference on Image Processing (ICIP 2021), Anchorage, Alaska, USA.
  10. Mar 2021: A paper titled 'Deep neural network hyper-parameter tuning through two-fold genetic approach' got accepted in Springer Soft Computing (SoCo) Journal.
  11. Dec 2020: Received the Best Paper Award in the International Conference on Computer Vision & Image Processing (CVIP 2020).
  12. Oct 2020: A paper titled 'End-to-end Triplet Loss based Emotion Embedding for Speech Emotion Recognition' got accepted in The 25th International Conference on Pattern Recognition (ICPR 2020), Milan, Italy.
  13. Jul 2020: A paper titled 'Fast Griffin Lim based Waveform Generation Strategy for TTS Synthesis' got accepted in Springer Multimedia Tools and Applications (MTAP) Journal.
  14. May 2020: Became a reviewer of Springer Nature Computer Science (SNCS) Journal.
  15. Dec 2019: Visited Osaka Prefecture University, Japan for 3 weeks under Japan Science and Technology Sakura Science Plan.
  16. Aug 2019: Two papers titled 'A Segment Level Approach to Speech Emotion Recognition using Transfer Learning' and 'A GAN based Ensemble Technique for Automatic Evaluation of Synthetic Speech' accepted in The 5th Asian Conference on Pattern Recognition (ACPR 2019).
  17. May 2019: Became a reviewer of IEEE Communication Letters Journal.
  18. Nov 2018: Received M.E. (Computer Science) degree along with Institute Gold Medal from Thapar University, India.
  19. Jul 2018: Started pursuing Ph.D. at Machine Intelligence Lab, IIT Roorkee advised by Prof. R. Balasubramanian.
  20. Jan 2018: A paper titled 'MVO-Based 2-D Path Planning Scheme in UAV Environment' got accepted in IEEE Internet of Things (IoT) Journal.

Education

Ph.D. (Computer Science)*

Indian Institute of Technology, Roorkee, Uttrakhand, India

• Jul 2018 - Aug 2022 • CGPA: 9.00/10
• Thesis Area: Multi-modal Emotion Analysis.
• Supervisor: Prof. R. Balasubramanian

M.E. (Computer Science)

Thapar Institute of Engineering & Technology, Thapar University, Patiala, Punjab, India.

• Jul 2016 - Jun 2018 • CGPA: 9.38/10
• Thesis Topic: Meta-heuristic based Optimization of Deep Neural Networks
• Supervisor: Dr. Shalini Batra

B.E. (Computer Science)

Manipal Institute of Technology, Manipal University, Manipal, Karnataka, India.

• June 2010 - May 2014 • CGPA: 7.47/10
• Mentor: Prof. Harish SV

Work Experience

Osaka Prefecture University (OPU), Osaka, Japan

Visiting Researcher• Dec 2019

Worked at the Department of Computer Science and Intelligent Systems, OPU, Osaka, Japan, under Japan Science and Technology Sakura Science Plan.

Samsung R&D, New Delhi, India

Visiting Researcher• July 2018 - June 2019

Worked on ‘End to End Emotional Speech Synthesis’ project, sponsored by Samsung R&D, in the investigation of Prof. R. Balasubramanian, IIT Roorkee.

Oracle India Pvt. Ltd., Hyderabad, India

Software Engineer• May 2014 - May 2016

Worked with the Software Development team for the sustenance of a project management tool 'Oracle Primavera P6 Professional'.

Oracle India Pvt. Ltd., Hyderabad, India

Project Intern• Jan 2014 - May 2014

Worked with the Software Testing team for the quality assurance of 'Oracle Primavera P6 Enterprise Project Portfolio Management Web'.

Research Interests

  • Multimodal Emotion Analysis & Affective Computing
  • Machine Learning & Deep Learning
  • Image-Text-Speech Processing
  • Metaheuristic Optimization Techniques

Publications


1.     Puneet Kumar, Kshitij Pathania and Balasubramanian Raman. "Zero-shot Learning based Cross-lingual Sentiment Analysis for Sanskrit Text with Insufficient Labeled Data." Springer Applied Intelligence (APIN) Journal. [SCI, Q2, IF = 5.019]


2.     Puneet Kumar and Balasubramanian Raman. "A BERT Based Dual-Channel Explainable Text Emotion Recognition System." Elsevier Neural Networks (NeuNet) Journal. [SCI, Q1, IF = 8.05]


3.     Sarthak Malik, Puneet Kumar and Balasubramanian Raman. "Towards Interpretable Facial Emotion Recognition." 12th Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP 2021). [IAPR Endorsed']
4.     Puneet Kumar, Vishesh Kaushik and Balasubramanian Raman. "Towards the explainability of Multimodal Speech Emotion Recognition." 22nd Annual Conference of the International Speech Communication Association (Interspeech 2021). [CORE A | Qualis A1]


5.     Puneet Kumar, Vedanti Khokher, Yukti Gupta and Balasubramanian Raman. "Hybrid Fusion Based Approach for Multimodal Emotion Recognition with Insufficient Labelled Data." 28th IEEE International Conference on Image Processing (ICIP 2021). [CORE B | Qualis A1]


6.     Puneet Kumar, Shalini Batra and Balasubramanian Raman. "Deep neural network hyper-parameter tuning through two-fold genetic approach." Springer Soft Computing (SoCo) Journal. [SCI, Q2, IF = 3.05]
7.     Puneet Kumar, Sidharth Jain, Balasubramanian Raman, Partha Pratim Roy and and Masakazu Iwamura. "End-to-end Triplet Loss based Emotion Embedding System for Speech Emotion Recognition."The 25th International Conference on Pattern Recognition (ICPR 2020). [CORE B | Qualis A1]

8.     Puneet Kumar and Balasubramanian Raman. "Domain Adaptation based Technique for Image Emotion Recognition using Image Captions." 5th IAPR Inetrnational Conference on Computer Vision and Image Processing (CVIP 2020). [IAPR Endorsed | Got the 'Best Paper Award']

9.     Ankit Sharma, Puneet Kumar, Vikas M, Nagasai M, Kishore K, Sriram K, Balasubramanian Raman and Partha Pratim Roy. "Fast Griffin Lim based Waveform Generation Strategy for Text-to-Speech Synthesis." Springer Multimedia Tools and Applications (MTAP) Journal. [SCI, Q2, IF = 2.31]

10.     Sourav Sahoo, Puneet Kumar, Balasubramanian Raman and Partha Pratim Roy. "A Segment Level Approach to Speech Emotion Recognition using Transfer Learning." The 5th Asian Conference on Pattern Recognition (ACPR 2019). [IAPR Endorsed]

11.     J. Jaiswal, A. Chaubey, B. Reddy, S. Kashyap, Puneet Kumar, Balasubramanian Raman and Partha Pratim Roy. "A Generative Adversarial Network based Ensemble Technique for Automatic Evaluation of Synthetic Speech." The 5th Asian Conference on Pattern Recognition (ACPR 2019). [IAPR Endorsed]

12.     Puneet Kumar, Sahil Garg, Amritpal Singh, Shalini Batra, Neeraj Kumar and Ilsun You. "MVO-Based 2-D Path Planning Scheme for Providing Quality of Service in UAV Environment." IEEE Internet of Things (IoT) Journal 5, no. 3 (2018): 1698-1707. [SCI, Q1, IF = 9.94]

13.     Puneet Kumar and Shalini Batra. "Meta-heuristic based Optimized Deep Neural Network for Streaming Data Prediction." International Conference on Advances in Computing, Communication Control and Networking (ICACCCN 2018). [Listed in Scopus]

Awards

  • Registration support from the Alumni fund, IIT Roorkee to present a research paper in the 28th International Conference on Image Processing (ICIP), Alaska, USA.
  • Registration support from CSE Department, IIT Roorkee to present a research paper in the 22nd Annual Conference of the International Speech Communication Association (Interspeech 2021), Brno, Czech Republic, Europe.
  • Registration support from Microsoft Research Grant to present a research paper at the 25th IEEE International Conference on Pattern Recognition (ICPR 2020), Milan, Italy, Europe.
  • Received the Best Paper Award in the 5th IAPR International Conference on Computer Vision & Image Processing (CVIP'20).
  • Got selected to visit Osaka Prefecture University, Osaka, Japan under Japan Science and Technology Sakura Science Plan from 4-18 December 2019; received travel support from Osaka Prefecture University, Japan for the same.
  • Travel support from CSE Department, IIT Roorkee to attend 4th Summer School on Machine Learning and Computer Vision at the International Institute of Information Technology (IIIT) Hyderabad, India in July 2019.
  • Travel support from CSE Department, IIT Roorkee to attend the 11th Indian Conference on `Computer Vision, Graphics and Image Processing' (ICVGIP 2018) at IIIT Hyberabad and the Indian School of Business (ISB) Hyderabad, India in December 2018.
  • Received the Institute Gold Medal in M.E. (CSE) in Nov 2018.
  • Received MHRD Scholarships during M.E. (2016-18) and Ph.D. (2018-22).
  • Qualified CBSE UGC NET Computer Science in Nov 2017.
  • Qualified GATE Computer Science (Rank 2205, percentile 97.91) in 2016.

Patent/Copyrights

  • Copyright entitled 'Deep Neural Network Explainability Technique with Application in Multimodal Emotion Recognition', Puneet Kumar, Vishesh Kaushik, and Balasubramanian Raman. (Status: Registered, Certificate No. L-106713/2021; Dairy No. 13305/2021-CO/SW & 13261/2021-CO/L).

Trainings Given

  • Organized a training session on 'Dimensionality Reduction Algorithms' during the workshop on Digital Image Processing & Applications (DIPA) at NIT Arunachal Pradesh. Aug 2020.
  • Conducted a training session on 'Classification Algorithms using Python' during the 'Winter FDP on AI and Machine Learning' at E&ICT Academy, IIT Roorkee. Dec 2019.
  • Organized a training session on 'Sequence-to-sequence learning' during the course 'Deep Learning and Applications' at E&ICT Academy, IIT Roorkee. Aug 2019.
  • Organized a workshop on 'Deep Learning 101’ during Thapar Summer School 2018 at Thapar Institute of Engineering and Technology, Patiala, Punjab. Jun 2018.

Trainings Taken

  • Attended IEEE 22nd International Workshop on 'Multimedia Signal Processing' (MMSP), Tampere, Finland. Sep 2020.
  • Visited Osaka Prefecture University, Osaka, Japan under Japan Science and Technology Sakura Science Plan. Dec 2019.
  • Attended 4th International Conference on 'Computer Vision and Image Processing' (CVIP), MNIT Jaipur. Sep 2019.
  • Attended 4th Summer School on Machine Learning and Computer Vision, IIIT Hyderabad. July 2019.
  • Attended a Technical Session on 'Microsoft Azure Cloud Computing Platform', IIT Roorkee. Apr 2019.
  • Attended 11th Indian Conference on 'Computer Vision, Graphics and Image Processing' (ICVGIP), IIIT Hyderabad. Dec 2018
  • Attended Workshop on 'Computer Vision and Image Processing', IIT Roorkee. Mar 2018.
  • Attended Short term course on 'Deep Learning and Applications', IIT Kanpur. Jan 2017.
© Puneet Kumar (2021)