A 360 review of AI agent benchmarks
Research
Kim Martineau
Generative AI
Generative AI is revolutionizing how the world computes, but there are still roadblocks for scaling to solve real business problems. At IBM Research, we’re working on trustworthy models, software, and infrastructure to allow any business to harness the power of generative AI.
Our work
The simplest protocol for AI agents to work together
ResearchKim MartineauAn invisible watermark to keep tabs on tabular data
ResearchKim MartineauAI is changing how we work — is it time to change how we credit AI’s involvement?
ResearchKim MartineauIBM crossed a transformer with an SSM and got ‘Bamba’
NewsKim MartineauA new kind of adapter helps LLMs get their words out faster
ResearchKim Martineau- See more of our work on Generative AI
Publications
ConCodeEval: Evaluating Large Language Models for Code Constraints in Domain-Specific Languages
- Mehant Kammakomati
- Sameer Pimparkhede
- et al.
- 2025
- ACL 2025
AUTOCIRCUIT-RL: Reinforcement Learning-Driven LLM for Automated Circuit Topology Generation
- Prashanth Vijayaraghavan
- Luyao Shi
- et al.
- 2025
- ICML 2025
Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead
- Rickard Gabrielsson
- Jiacheng Zhu
- et al.
- 2025
- ICML 2025
Improving LLM-Powered EDA Assistants with RAFT
- Luyao Shi
- Michael Kazda
- et al.
- 2025
- ICLAD 2025
Lightning Talk: Serving guardrail detectors on vLLM
- Evaline Ju
- 2025
- OSSNA 2025
CIRCUITSYNTH-RL: LLM-Based Circuit Topology Synthesis with RL Refinement
- Prashanth Vijayaraghavan
- Luyao Shi
- et al.
- 2025
- DAC 2025