About Experience Publications Research Contact Music SceneSenseAI ✦ View CV
New York, USA · Open to PhD programs & investors

Rajarshi
Ray

I build agentic AI systems that ship at enterprise scale by day, and generative vision models that push research benchmarks by night. Now channeling both into SceneSenseAI, with a PhD next.

Portrait of Rajarshi Ray
🏆 CVPR 2025 · NTIRE
🧠 Patent-pending Agentic AI
⚡ IBM z17 LinuxONE
🚀 SceneSenseAI
scroll
0
synthetic transactions per run, patent-pending system
0
global rank · NTIRE 2025 Super-Resolution @ CVPR
0
robotics scenarios benchmarked with IBM Research
0
self-hosted LLMs serving 20–25 IBM engineers daily
Built & trained at
IBM logo
Stony Brook University logo
BITS Pilani logoBITS Pilani
Indian Institute of Science logoIndian Institute
of Science
01 · About

Engineer by trade, researcher at heart, entrepreneur by obsession.

I'm Rajarshi: born in Virginia, raised in Bangalore (India's tech capital), and now building AI in New York. That mix of places gave me a simple operating principle: great technology should feel effortless to the person using it, no matter how hard it was to build.

After computer science at BITS Pilani, I finished my M.S. in Computer Science at Stony Brook University, researching generative vision (diffusion models, VAEs, and image restoration) under Prof. Klaus Mueller. That work took me to CVPR 2025, where my team ranked 18th globally in the NTIRE Super-Resolution challenge.

Today I'm a Staff-level AI Engineer at IBM, architecting a patent-pending agentic AI system for the z17 LinuxONE platform and collaborating with IBM Research on agentic workflows for industrial robotics. On nights and weekends, I'm a part-time entrepreneur running SceneSenseAI, building AI teaching assistants that make video course libraries actually searchable.

The through-line: I want to keep doing this at the deepest level possible, which is why the next stop is a PhD.

M.S. Computer Science · Stony Brook University

Computer Vision, NLP, AI, Data Science · Dec 2025

B.E. Computer Science · BITS Pilani

AI, Data Science & Visualization · TA for Object-Oriented Programming · 2024

🎯

Next: PhD in AI / Computer Vision

Generative models, agentic systems, and AI for healthcare & education.

🎸

Off the clock

Guitar, singing, movie deep-dives, and building robots that talk back.

02 · Experience

Where I've shipped.

From graduate research lab to staff-level engineering at IBM, in under two years.

Feb 2026 – Present Current Poughkeepsie, NY · Hybrid
IBM

Staff Engineer, Artificial Intelligence

IBM · LinuxONE / Hybrid Cloud

  • Architecting a patent-pending agentic AI system generating 100K+ synthetic financial transactions per run for large-scale workload testing on IBM z17 LinuxONE, fully on-prem to meet enterprise security requirements.
  • Collaborating with IBM Research to benchmark agentic AI workflows for industrial robotics: 4 agent architectures across 4,000+ real-world asset-inspection scenarios, targeting an ICLR 2027 submission.
  • Running a locally deployed AI playground on IBM GPU infrastructure: 10 self-hosted LLMs serving 20–25 engineers for day-to-day experimentation and prototyping.
May 2025 – Feb 2026 New York · On-site
IBM

Software Engineer Intern

IBM · LinuxONE Hybrid Cloud Integration & Test

  • Deployed and ported 6 microservices across x86 and s390x architectures using Podman and OpenShift Pipelines.
  • Engineered a JMeter-based pipeline for automated workload testing, achieving a 98% success rate in simulating real-world usage.
  • Contributed to the WatsonX Challenge by designing an agentic AI framework for persona-driven synthetic transaction data generation.
Aug 2024 – Feb 2026 Stony Brook, NY
Stony Brook University

Graduate Researcher

Stony Brook University · VAI-GM Lab, advised by Prof. Klaus Mueller

  • Researched computer vision and medical image synthesis: diffusion models and variational autoencoders for high-fidelity 3D lung CT generation.
  • Ranked 18th in the NTIRE 2025 Image Super-Resolution (×4) Challenge at CVPR 2025, contributing high-performance models for perceptually accurate upscaling.
  • Built and maintained a robust DICOM server for storage, retrieval, and analysis of large-scale medical imaging datasets.
S
SceneSense.AI
● PART-TIME ENTREPRENEUR · LIVE IN EARLY ACCESS

Your course videos hold every answer. Now your students can find them.

SceneSenseAI connects to your video library, a Google Drive folder or a YouTube playlist, and turns it into an AI teaching assistant. Learners ask in plain English and get answers cited with exact timestamps; click a citation and the built-in player jumps to that second of that video.

  • ⏱Timestamp-grounded answers: every response cites the exact video and moment, verifiable in one click. No hallucinated lectures.
  • 🎓A team of teaching agents: a quiz master that targets your weak spots, a tutor that asks one small question back, and a navigator that maps your library as a knowledge graph.
  • ⚡No-code setup: point it at your folder or playlist; new videos are picked up and indexed automatically.
S SceneSense.AI Product demo · 35s
03 · Publications

On the record.

2027
In preparation

InspectionBench: Embodied Industrial Anomaly Verification with Perception-Grounded Physical AI Evaluation

With IBM Research: evaluating 4 agent architectures across 4,000+ real-world asset-inspection scenarios. Targeting ICLR 2027.

2026
IBM Z · LinuxONE

From Prompt to Pipeline: AI-Powered Transaction Generation and Workload Testing on IBM Z LinuxONE

Ray R., IBM Z & LinuxONE Community, June 2026. A framework that turns natural-language instructions into fully executed performance tests on IBM Z LinuxONE, orchestrated end-to-end by AI agents.

2026
IBM Z · LinuxONE

Synthetic Transaction Generation Powered by AI Agents

Ray R., IBM Z & LinuxONE Community, March 2026. Generating realistic synthetic financial transaction data with agentic AI on IBM Granite models: privacy-safe workload testing without touching real customer data.

2025
IBM Z · LinuxONE

Porting and Deployment of the AWS Retail Store Application on the IBM s390x Platform using OpenShift

Ray R., IBM Z & LinuxONE Community, September 2025. Bringing a cloud-native multi-service application to s390x with OpenShift: multi-arch builds, datastore swaps, and architecture-specific fixes.

2025
CVPR-W · NTIRE

NTIRE 2025 Image Super-Resolution (×4) Challenge Report

Chen Z., Ray R., Tomar S.S., Mueller K., et al., Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), NTIRE Workshop, June 2025. Team VAI-GM's MDRCT achieved 30.86 dB PSNR / 0.8942 SSIM, ranking 18th globally.

04 · Research & Projects

Pushing pixels, tokens, and benchmarks.

Generative vision, agentic systems, and the occasional robot: the work fueling my PhD ambitions.

Toward ICLR 2027
🤖

InspectionBench: Embodied Industrial Anomaly Verification

With IBM Research: perception-grounded evaluation of physical AI, benchmarking 4 agent architectures across 4,000+ real-world asset-inspection scenarios.

Agentic AIRoboticsBenchmarking
CVPR 2025
🔍

MDRCT: Image Super-Resolution ×4

Led Team VAI-GM in the NTIRE 2025 challenge. Designed the Multi-step Dense Residual Connected Transformer, hitting 30.86 dB PSNR and ranking 18th among global research teams.

TransformersSuper-ResolutionPyTorch
Medical AI
🫁

3D Lung CT Synthesis with Diffusion

Encoded medical images into latent space with VQ-VAE and generated high-fidelity 3D lung CTs via guided diffusion, plus an Orthanc DICOM server for secure storage at scale.

DiffusionVQ-VAEDICOM
Open Source
💻

CodeSIM-Lite: Local Agentic Codegen

Re-architected the CodeSIM agent loop for 4-bit quantized models (Gemma-2-9B, CodeLlama-7B), keeping HumanEval performance strong under strict hardware and privacy budgets.

Agentic AIQuantizationLLMs
View on GitHub
Multimodal
🎭

Multimodal Emotion Recognition

Fused text, audio, and visual embeddings (concatenation, Hadamard, cross-attention) on the MELD dataset, across unimodal to trimodal setups. The seed that grew into SceneSenseAI.

MultimodalCross-AttentionMELD
View on GitHub
IISc Bangalore
🔐

Confidential Computing for Medical AI

At IUDX, IISc: a secure pneumonia-classification pipeline running inside AMD SEV-SNP enclaves with TPM-backed storage and remote inference, ~20% faster than comparable Intel SGX and AWS Nitro stacks.

AMD SEV-SNPTPM 2.0Medical AI
Python PyTorch Agentic AI Diffusion Models VAEs & GANs Transformers LLMs RAG Computer Vision TensorFlow Hugging Face OpenCV
OpenShift Kubernetes Podman & Docker Linux s390x Tekton Pipelines JMeter C/C++ Java Model Quantization DICOM Git Raspberry Pi