An Automatic Bottom-up Idea Grouping Method based on LLMs

Authors

  • Takayuki Ito Kyoto University
  • Shun Okuhara Mie University

DOI:

https://doi.org/10.52731/liir.v006.326

Keywords:

AI-based Discussion Support, LLM-based Grouping, KJ Method

Abstract

This paper presents a novel automatic Bottom-up idea grouping method leveraging Large Language Models (LLMs) to facilitate the organization of ideas and concepts. Traditional methods of idea grouping, such as the KJ method, require significant manual effort to group and synthesize information effectively. Our approach utilizes the contextual understanding and grouping capabilities of LLMs to automate this process, aiming to reduce cognitive load and improve efficiency. By performing unsupervised grouping based on the insight of each idea, the model automatically generates cohesive idea groups from diverse sets of inputs in the bottom-up way. We evaluate the effectiveness of our method on qualitative datasets, comparing it with top-down categorizing method. Results indicate that the proposed bottom-up method not only aligns well with human clustering but also demonstrates a high level of interpretability and accuracy in grouping similar ideas. This study highlights the potential of LLMs in transforming qualitative analysis by offering a scalable and intuitive solution for idea grouping.

References

Tim Brown. Design thinking. Harvard Business Review, 86:84–92, 2008.

Yihan Dong, Shiyao Ding, and Takayuki Ito. An automated multi-phase facilitation agent based on llm. IEICE TRANSACTIONS on Information and Systems, pages 1–10, 12 2023.

Rafik Hadfi, Shun Okuhara, Jawad Haqbeen, Sofia Sahab, Susumu Ohnuma, and Takayuki Ito. Conversational agents enhance women’s contribution in online debates. Scientific Reports, 13(1):14534, 2023.

Jawad Haqbeen, Sofia Sahab, and Takayuki Ito. How did discourse shift among afghan citizens during the fall of republic: Early insights using conversational ai platform. In Proceedings of the 23rd Annual International Conference on Digital Government Research, dg.o ’22, page 480–482, New York, NY, USA, 2022. Association for Computing Machinery.

Jawad Haqbeen, Sofia Sahab, and Takayuki Ito. In solidarity with ukraine through conversational ai via facebook ads: A case study of online discussion in 15 countries. In Proceedings of the 24th Annual International Conference on Digital Government Research, DGO ’23, pages 639–641, New York, NY, USA, 2023. Association for Computing Machinery.

Takayuki Ito, Rafik Hadfi, and Shota Suzuki. An agent that facilitates crowd discussion. Group Decision and Negotiation, 31(3):621–647, 2022.

Jiro Kawakita. Hassoho. Chuokoronshinsya, 1967.

Moeka Nomura, Takayuki Ito, and Shiyao Ding. Towards collaborative brain-storming among humans and ai agents: An implementation of the ibis-based brainstorming support system with multiple ai agents. In Proceedings of the ACM Collective Intelligence Conference, CI ’24, page 1–9, New York, NY, USA, 2024. ACM.

Sofia Sahab, Jawad Haqbeen, Rafik Hadfi, Takayuki Ito, Richard Eke Imade, Susumu Ohnuma, and Takuya Hasegawa. E-contact facilitated by conversational agents reduces interethnic prejudice and anxiety in afghanistan. Communications Psychology, 2(1):22, 2024.

Sofia Sahab, Jawad Haqbeen, and Takayuki Ito. Facilitating the problems that lie within the solutions using conversational ai: A case study of post-2021 afghanistan. In Proceedings of the 24th Annual International Conference on Digital Government Research, DGO ’23, pages 654–656, New York, NY, USA, 2023. Association for Computing Machinery.

Sofia Sahab, Jawad Haqbeen, and Takayuki Ito. Conversational ai as a facilitator improves participant engagement and problem-solving in online discussion: Sharing evidence from five cities in afghanistan. IEICE TRANSACTIONS on Information and Systems, pages 1–10, 01 2024.

Michael Henry Tessler, Michiel A. Bakker, Daniel Jarrett, Hannah Sheahan, Martin J. Chadwick, Raphael Koster, Georgina Evans, Lucy Campbell-Gillingham, Tantum Collins, David C. Parkes, Matthew Botvinick, and Christopher Summerfield. Ai can help humans find common ground in democratic deliberation. Science, 386(6719):eadq2852, 2024.

Downloads

Published

2025-02-22