Jamuna S Murthy

Assistant Professor · Ramaiah Institute of Technology

I am an Assistant Professor in the Department of Computer Science and Engineering at Ramaiah Institute of Technology, Bengaluru, India, affiliated with the Center for Imaging Technologies. My research centers on vision–language models and scalable AI systems — models that ground language in images, video, and audio, and the efficient architectures and infrastructure that let them run reliably in the real world, from edge devices to cloud services. My latest focus is the theory of controllable image generation: treating controllability as a property of structured latent geometry rather than inference-time conditioning (Controlla), and measuring what generated images lose in meaning (KathaTrace), both as a research collaborator with Prof. Rajiv Ramnath's CETI research group at The Ohio State University. I received my M.Tech. from Ramaiah Institute of Technology, where my thesis won the Best Master's Thesis Award (2017), and in 2024 I received the STEM Young Researcher Award.

News

  • Sep 2026 New Multimodal Humor Detection in Videos via Domain-Specific Representations and Deep Hybrid Fusion Networks — up to 95.8% accuracy on IEMOCAP, CMU-MOSI, and CMU-MOSEI — accepted in Soft Computing (Springer Nature).
  • Jul 2026 CAMMEL-ViT — context-aware memory with lightweight vision transformers for 2D and 3D medical image segmentation — accepted and presented at MIUA 2026, University College Dublin (video).
  • Jul 2026 KathaTrace — diagnosing semantic trajectory collapse in generated visual narratives, with the KathaBench-25K benchmark — published on arXiv and under submission to a CORE A* venue. New work with the CETI research group, The Ohio State University.
  • May 2026 Controlla — learning controllability via graph-constrained latent geometry, with the AffectHuman-43K benchmark — published on arXiv and under submission to a CORE A* venue. New work with the CETI research group, The Ohio State University.
  • 2026 Serving as a reviewer for AAAI 2027, AISTATS 2027, and ACM Multimedia 2027.
  • 2025 Serving as a reviewer for NeurIPS 2026, AAAI 2026, AISTATS 2026, ACM Multimedia 2026, and ACM Multimedia Asia 2026.
  • Nov 2025 Completed the Samsung PRISM worklet NextGen AI Datastore for multimodal video retrieval as faculty mentor (certificate).
  • Aug 2025 FewShot-SPT — few-shot spatiotemporal perception transformer for unseen behavioral anomalies, deployed on edge hardware — published at IEEE AVSS 2025 (CORE A). Work in collaboration with The Ohio State University and Ming Chi University of Technology.
  • Apr 2025 Joined Verity Labs (California) as an AI Researcher on the AI-ACC-Stack project.
  • 2025 Deep Hybrid Fusion published in Multimedia Tools and Applications.
  • Nov 2024 Received the Young Researcher Award from the STEM Research Society.
  • Jun 2024 Faculty mentor for the Samsung PRISM program on expression correction in photos.

Research Interests

Controllable Image Generation: Theory Latest

Controllability as a property of latent geometry — factorized identity and attribute spaces aligned with graph priors through optimal transport, so edits follow consistent trajectories while identity is preserved — and principled measures of whether generated images still carry the intended meaning.

Vision–Language & Multimodal Understanding

Grounding language in visual and acoustic signals — cross-modal attention and hybrid fusion of text, image, and audio representations for understanding subtle, human-centric content such as humor and sarcasm in video.

Efficient Vision Transformers for Real-World Perception

Lightweight, memory-efficient transformers that keep global context affordable — for medical image segmentation, few-shot video anomaly detection on edge hardware, real-time driver assistance, and surgical video analytics.

Scalable AI Systems

Infrastructure that takes models to production — vision–language retrieval over large video collections, RAG and tool-calling agent stacks, and low-latency streaming analytics on distributed systems.

Selected Publications

Show more publications

Experience

  • Assistant Professor — Ramaiah Institute of Technology, Department of CSE
    2022 – present · Bengaluru, India
    • Lab affiliation: Center for Imaging Technologies.
    • Research collaborator with Prof. Rajiv Ramnath's CETI research group, The Ohio State University, on controllable image generation and generated visual narratives.
    • Teaches Artificial Intelligence and Machine Learning, Object Oriented Programming, Cloud Computing and Big Data, and Introduction to Deep Learning; faculty sponsor of the RIT ACM Student Chapter.
  • AI Researcher — Verity Labs Inc. (AI-ACC-Stack)
    Apr 2025 – Sep 2025 · Remote (California)
    • Built a modular AI backend stack covering retrieval-augmented generation, LLM integration, document ingestion, tool-calling agents, structured querying, and authentication.
    • Deployed AI services on cloud platforms (AWS, Azure, GCP) with cross-functional teams, using PyTorch, TensorFlow, and Scikit-learn.
  • Faculty Mentor — Samsung PRISM (Samsung R&D)
    Jun 2024 – Nov 2025 · Bengaluru, India
    • Expression Correction in Photos: GAN-based affective computing models for emotion-aware image enhancement, including blink and expression refinement. Certificate
    • NextGen AI Datastore for Video Retrieval (May – Nov 2025, completed): a scalable vector database for multimodal video retrieval with vision–language embeddings, focused on semantic search, indexing, and real-time retrieval. Certificate
  • Assistant Professor — BNM Institute of Technology, Department of ISE
    2020 – 2022 · Bengaluru, India
    • Head of the Google Cloud Center of Excellence.
  • Assistant Professor — PES University, Department of CSE
    2018 – 2020 · Bengaluru, India
    • Lab affiliation: Centre for Data Science & Applied Machine Learning (CDSAML).
  • Research Assistant — Indian Institute of Science, Department of CDS
    2017 – 2018 · Bengaluru, India
  • Intern — Amazon
    Jun 2016 – Jun 2017

Funding & Patents

  • FitQua: Smart Water Bottle for AI-Based Health Tracking — DST-funded project 2021 – 2022 · An intelligent hydration system combining thermal control (Peltier cooling and resistive heating) with sensor fusion (temperature, load, activity) for AI-driven hydration monitoring.
  • Surgeon's Eye: Intelligent Video Analytical Framework for Robotic and Laparoscopic Surgery — Patent 2025 · Application No. 202541008338 · Jamuna S. Murthy, Dhanashekar Kandaswamy, Siddesh G. M.

Academic Service

Reviewing

VenueReviewing
NeurIPS2026
AAAI2025, 2026, 2027
AISTATS2026, 2027
ICCV2025
ECCV2026
ACM Multimedia2025, 2026, 2027
ACM Multimedia Asia2025, 2026
Springer Nature JournalsGold Reviewer, 2020 – presentScientific Reports · Journal of Big Data · Signal, Image and Video Processing · Discover Informatics · Language Resources and Evaluation · Discover Artificial Intelligence · International Journal of Machine Learning and Cybernetics · Journal of Ambient Intelligence and Humanized Computing · Discover Education · International Journal of Computational Intelligence Systems · The Journal of Supercomputing

Student Mentoring

  • Smart India Hackathon 2023 — Winning team, as faculty mentor Grand Finale, Senior Software Edition, December 2023 · Ministry of Education, Government of India · Certificate
  • Unisys Innovation Program — Faculty mentor Mentored finalist teams three years running: 2023, 2024, 2025
  • ICPC — Mentor and coach 2023, 2024, 2025 · ICPC Asia Amritapuri Regional 2024 Certificate
  • Samsung PRISM — Faculty mentor 2024 – 2025 · Two industry worklets with Samsung R&D (see Experience)

Leadership & Memberships

  • Faculty Sponsor, RIT ACM Student Chapter 2023 – present · Ramaiah Institute of Technology
  • Member, Association for Computing Machinery (ACM) Since 2020
  • Lifetime Member, Indian Society for Technical Education (ISTE)

Awards & Honors

  • 2024 Young Researcher Award, STEM Research Society.
  • 2023 Smart India Hackathon — Winner (as faculty mentor of the winning team), Ministry of Education, Government of India. Certificate
  • 2017 Best Master's Thesis Award, Ramaiah Institute of Technology. For Distributed Framework for Real-Time Twitter Sentiment Analysis and Visualization (TwitSenti).
  • 2016–17 TEQIP-funded Graduate Teaching Assistantship, Ramaiah Institute of Technology.

Education

  • M.Tech. in Computer Software Engineering — Ramaiah Institute of Technology, Bengaluru 2015 – 2017 · Autonomous, affiliated to Visvesvaraya Technological University · GPA 9.30/10
    Thesis: Distributed Framework for Real-Time Twitter Sentiment Analysis and Visualization (TwitSenti) — Best Master's Thesis Award
  • B.E. in Computer Science and Engineering — Dr. Ambedkar Institute of Technology, Bengaluru 2011 – 2015 · Autonomous, affiliated to Visvesvaraya Technological University