Pluralistic Alignment

@ NeurIPS 2024 Workshop

December 14, 2024 in Vancouver, Canada

Exploring Pluralistic Perspectives in AI


Call for Papers Schedule

Welcome to the Pluralistic Alignment Workshop! Aligning AI with human preferences and values is increasingly important. Yet, today’s AI alignment methods have been shown to be insufficient for capturing the vast space of complex – and often conflicting – real-world values. Our workshop will discuss how to integrate diverse perspectives, values, and expertise into pluralistic AI alignment. We aim to explore new methods for multi-objective alignment by drawing inspiration from governance and consensus-building practices to address conflicting values in pluralistic AI alignment. Discussion will include technical approaches for dataset collection, algorithms development, and the design of human-AI interaction workflows that reflect pluralistic values among diverse populations. By gathering experts from various fields, this workshop seeks to foster interdisciplinary collaboration and push the boundaries of the understanding, development and practice of pluralistic AI alignment.

Stay tuned by following us on Twitter @pluralistic_ai.

Call for Papers

Our workshop aims to bring together researchers with diverse scientific backgrounds, including (but not limited to) machine learning, human-computer interaction, philosophy, and policy studies. More broadly, our workshop lies at the intersection of computer and social sciences. We welcome all interested researchers to discuss the aspects of pluralistic AI, from its definition to the technical pipeline to broad deployment and social acceptance.

We invite submissions that discuss the technical, philosophical, and societal aspects of pluralistic AI. We provide a non-exhaustive list of topics we hope to cover below. We also broadly welcome any submissions which are broadly relevant to pluralistic alignment.

  • Philosophy:
    • Definitions and frameworks for Pluralistic Alignment
    • Ethical considerations in aligning AI with diverse human values
  • Machine learning:
    • Methods for pluralistic ML training and learning algorithms
    • Methods for handling annotation disagreements
    • Evaluation metrics and datasets suitable for pluralistic AI
  • Human-computer interaction:
    • Designing human-AI interaction that reflects diverse user experiences and values
    • Integrating existing surveys on human values into AI design
    • Navigating privacy challenges in pluralistic AI systems
  • Social sciences:
    • Methods for achieving consensus and different forms of aggregation
    • Assessment and measurement of the social impact of pluralistic AI
    • Dealing with pluralistic AI representing values that are offensive to some cultural groups
  • Policy studies:
    • Policy and laws for the deployment of pluralistic AI
    • Democratic processes for incorporating diverse values into AI systems on a broad scale
  • Applications:
    • Case studies in areas such as hate speech mitigation and public health

Submission Instructions

We invite authors to submit anonymized papers up to 4 pages, excluding references and appendices. All submissions should be in PDF format and made through OpenReview submission portal. Submissions must follow the NeurIPS 2024 template. Checklists are not required for submissions. Reviews will be double-blind, with at least three reviewers assigned to each paper to ensure a thorough evaluation process.

We welcome various types of papers including works in progress, position papers, policy papers, academic papers. All accepted papers will be available on the workshop website, but are to be considered non-archival.

Travel Support

There will be a limited amount of travel grants to cover expenses. Financial support will be made available for lodging, and registration, subject to our available funding. Travel expenses are handled via reimbursement. We extend our thanks to OpenAI for their generous sponsorship of our workshop.

Please fill out the travel support application form by Oct 18, 2025 AOE.

Important Dates (Tentative)

All deadlines are 11:59 pm UTC-12h (“Anywhere on Earth”).

July 15, 2024 Call for Workshop Papers
Sep 07 Sep 10, 2024 Paper Submission Deadline
Oct 9, 2024 Notification of Acceptance
Oct 18, 2024 Travel Support Application Deadline
Oct 30, 2024 Camera-Ready Due
Dec 10, 2024 Release of Proceedings
Dec 14, 2024 Workshop Date

Speakers

Avatar

Yejin Choi

University of Washington

Avatar

Melanie Mitchell

Santa Fe Institute

Avatar

Seth Lazar

Australian National University

Avatar

Michael Bernstein

Stanford University

Avatar

Hannah Rose Kirk

University of Oxford

Schedule (Tentative)

Time Program
9:00-9:10 Opening remarks
9:10-9:55 Keynote Talk: Melanie Mitchell
9:55-10:40 Keynote Talk: Michael Bernstein
10:40-11:40 Poster Session & Coffee Break
11:40-12:25 Keynote Talk: Yejin Choi
12:25-13:30 Lunch Break
13:30-14:15 Keynote Talk: Seth Lazar
14:15-15:00 Keynote Talk: Monojit Choudhury
15:00-15:30 Coffee Break
15:30-16:50 5 Contributed Talks (10 mins talk + 5 mins Q&A)
16:50-17:50 Panel Discussion
17:50-18:00 Closing Remarks

Accepted Papers

To appear.

Organization

Organizing Committee

Avatar

Moksh Jain

Mila & Université de Montréal

Avatar

Ruyuan Wan

Pennsylvania State University

Avatar

Mitchell L. Gordon

OpenAI and MIT CSAIL

Avatar

Dongyeop Kang

University of Minnesota

Avatar

Maarten Sap

CMU LTI

Avatar

Amy Zhang

University of Washington

Avatar

He He

New York University

Scientific Advisory Board

Avatar

Yoshua Bengio

Mila & Université de Montréal

Avatar

Jeffrey P. Bigham

Carnegie Mellon University

Contact us

Please email pluralistic-alignment-neurips2024@googlegroups.com if you have any questions.

Sponsor