Qian Pan

Publications

• Synthetic Data for Evaluation: Supporting LLM-as-a-Judge Workflows with EvalAssist

  • • Elizabeth Daly
    • Erik Miehling
    • et al.
  • 2025
  • EMNLP 2025

• Granite Guardian: Comprehensive LLM Safeguarding

  • • Inkit Padhi
    • Manish Nagireddy
    • et al.
  • 2025
  • NAACL 2025

• Designing Scalable and Transparent Interfaces for Multi-Criteria Evaluation of LLM Outputs

  • • Lakshya Sharma
    • Amin El Asery
    • et al.
  • 2025
  • CHI 2025

• EvalAssist: LLM-as-a-judge simplified

  • • Michael Desmond
    • Zahra Ashktorab
    • et al.
  • 2025
  • AAAI 2025

• Human-Centered Design Recommendations for LLM-as-a-Judge

  • • Qian Pan
    • Zahra Ashktorab
    • et al.
  • 2024
  • ACL 2024

• EvaluLLM: LLM assisted evaluation of generative outputs

  • • Michael Desmond
    • Zahra Ashktorab
    • et al.
  • 2024
  • IUI 2024

• Reliance and Automation for Human-AI Collaborative Data Labeling Conflict Resolution

  • • Michelle Brachman
    • Michael Desmond
    • et al.
  • 2022
  • CSCW 2022

• AI Assisted Data Labeling with Interactive Auto Label

  • • Michael Desmond
    • Michelle Brachman
    • et al.
  • 2022
  • AAAI 2022

• AI Assisted Data Labeling

  • • Michael Desmond
    • Evelyn Duesterwald
    • et al.
  • 2020
  • NeurIPS 2020

• Fast and Automatic Visual Label Conflict Resolution

  • • Narendra Nath Joshi
    • A. Sharma
    • et al.
  • 2020
  • NeurIPS 2020