Papers

Papers by year released in reversed chronological order.

2024

2024

  1. arXiv
    GenQA: Generating Millions of Instructions from a Handful of Prompts
    Jiuhai Chen, Rifaa Qadri, Yuxin Wen, Neel Jain, John Kirchenbauer, Tianyi Zhou, and Tom Goldstein
    arXiv preprint arXiv:2406.10323,
    PDF Data
  2. NeurIPS
    Be like a Goldfish, Don’t Memorize! Mitigating Memorization in Generative LLMs
    Abhimanyu Hans, Yuxin Wen, Neel Jain, John Kirchenbauer, Hamid Kazemi, Prajwal Singhania, Siddharth Singh, Gowthami Somepalli, and 3 more authors
    Neural Information Processing Systems, 2024
    PDF Code
  3. arXiv
    LiveBench: A Challenging, Contamination-Free LLM Benchmark
    Colin White, Samuel Dooley, Manley Roberts, Arka Pal, Ben Feuer, Siddhartha Jain, Ravid Shwartz-Ziv, Neel Jain, and 3 more authors
    arXiv preprint arXiv:2406.19314,
    PDF Blog
  4. NeurIPS
    Transformers Can Do Arithmetic with the Right Embeddings
    Sean McLeish, Arpit Bansal, Alex Stein, Neel Jain, John Kirchenbauer, Brian R Bartoldson, Bhavya Kailkhura, Abhinav Bhatele, and 3 more authors
    Neural Information Processing Systems, 2024
    PDF Code

2023

2023

  1. ICLR
    NEFTune: Noisy Embeddings Improve Instruction Finetuning
    Neel Jain, Ping-yeh Chiang, Yuxin Wen, John Kirchenbauer, Hong-Min Chu, Gowthami Somepalli, Brian Bartoldson, Bhavya Kailkhura, and 5 more authors
    International Conference on Learning Representations, 2024
    PDF Code
  2. arXiv
    Baseline Defenses for Adversarial Attacks Against Aligned Language Models
    Neel Jain, Avi Schwarzschild, Yuxin Wen, Gowthami Somepalli, John Kirchenbauer, Ping-yeh Chiang, Micah Goldblum, Aniruddha Saha, and 2 more authors
    arXiv preprint arXiv:2309.00614, 2023
    PDF Code
  3. COLM
    Bring Your Own Data! Self-Supervised Evaluation for Large Language Models
    Neel Jain, Khalid Saifullah, Yuxin Wen, John Kirchenbauer, Manli Shu, Aniruddha Saha, Micah Goldblum, Jonas Geiping, and 1 more author
    Conference on Language Modeling, 2024
    PDF Code
  4. NeurIPS
    Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery
    Yuxin Wen, Neel Jain, John Kirchenbauer, Micah Goldblum, Jonas Geiping, and Tom Goldstein
    Neural Information Processing Systems, 2023
    PDF Code Demo

2022

2022

  1. How to Do a Vocab Swap? A Study of Embedding Replacement for Pre-trained Transformers
    Neel Jain, John Kirchenbauer, Jonas Geiping, and Tom Goldstein
    Preprint, 2022
    PDF

2020

2020

  1. Springer
    Multi-color forcing in graphs
    Chassidy Bozeman, Pamela E Harris, Neel Jain, Ben Young, and Teresa Yu
    Graphs and Combinatorics, 2020
    PDF