Dr. Nimmi Rangaswamy and her student Freyam Mehta presented a paper on Closing the Loop: Embedding Observability in the GenAI Product Lifecycle for Systematic Bias Mitigation to SIGCHI, ACM (Association of Computing Machinery) CHI conference on Human Factors in Computing Systems 2024, in their GenAICHI: CHI 2024 Workshop held in Hawaii from 11 to 16 May. This is a very prestigious conference. Here is the summary of the research work as explained by the authors:
Closing the Loop: Embedding Observability in the GenAI Product Lifecycle for Systematic Bias Mitigation, was a collaborative effort with AVID ML, focusing on the BiasAware initiative. As the lead, I spearheaded the development of BiasAware, an interactive platform hosted on Hugging Face, designed to evaluate datasets for biases. This initiative is a significant stride towards addressing the ethical challenges of inherent biases, particularly gender bias, within Generative Artificial Intelligence (GenAI) applications. By introducing an observability and governance framework through BiasAware, we provide a comprehensive method for identifying and mitigating biases early in the GenAI product lifecycle. This framework equips developers with the tools and methodologies for bias detection and mitigation, emphasizing the importance of continuous improvement via an Observability and Governance Layer. This layer is crucial for ensuring that GenAI systems consistently meet ethical standards, fostering responsible AI development. While focusing primarily on gender bias, BiasAware is flexible enough to address a wide range of social biases, adapting to the evolving capabilities of GenAI and its impact on future human-AI interactions. Our goal is to contribute to the creation of GenAI technologies that are innovative, inclusive, and reflective of diverse societal values and norms.
Full paper: https://generativeaiandhci.github.io/papers/2024/genaichi2024_49.pdf
The ACM (Association of Computing Machinery) CHI conference on Human Factors in Computing Systems is the premier international conference of Human-Computer Interaction.
CHI (pronounced “kai”) was held in Honolulu, at the Hawaiʻi Convention Center on the island of Oʻahu, Hawaiʻi, USA from 11 – 16 May, while also supporting remote attendance.
The conference was on the theme of Surfing the World – reflecting the focus on pushing forth the wave of cutting-edge technology and riding the tide of new developments in human-computer interaction. The conference served as a platform for researchers, practitioners, and industry leaders to share their latest work and ideas and to foster collaboration and innovation in the field. Attendees Surfed the World of Technology by engaging in keynote speeches, panel discussions, workshops, and other interactive sessions focusing on the latest developments and trends in the field. The conference’s location, known for its beautiful beaches and world-class surf spots, adds a unique and inspiring setting for attendees to come together and exchange ideas to open global access to CHI. The CHI conference was the premier event in the field and Surfing the World represents its commitment to inviting everyone to explore and advance the frontiers of human-computer interaction.
Conference page: https://chi2024.acm.org/
May 2024