Large Language Models with Agent-Based Modeling and Software Engineering

Report on Current Developments in the Research Area

General Direction of the Field

The recent advancements in the research area are significantly driven by the integration of Large Language Models (LLMs) with agent-based modeling (ABM) and software engineering (SE). This fusion is leading to more sophisticated, adaptive, and scalable systems that can handle complex tasks and interactions in various domains, including social media opinion dynamics, pandemic planning, and multi-agent systems. The field is moving towards creating more unified and modular frameworks that enhance the capabilities of LLM-based agents, making them more efficient, accurate, and interpretable.

One of the key trends is the development of frameworks that combine the strengths of LLMs with traditional ABMs to create more realistic and adaptive agent behaviors. These frameworks are not only improving the accuracy of simulations but also enabling large-scale simulations that were previously computationally infeasible. The focus is on creating scalable solutions that can handle millions of agents while maintaining high-resolution behavior, as seen in the development of frameworks like AgentTorch.

Another significant direction is the creation of open-source systems that promote transparency, reproducibility, and further research. These systems, such as Cognitive Kernel and LLM-Agent-UMF, are designed to be modular and flexible, allowing for seamless integration of various components and tools. This modularity is crucial for advancing the field, as it enables researchers to build upon existing work and create more sophisticated systems.

The field is also witnessing a shift towards reactive environments that facilitate complex multi-agent interactions and communication. These environments, as introduced in the Reactive Environments framework, allow for more sophisticated and conditional communication between agents, which is essential for modeling complex systems.

Noteworthy Papers

  • FDE-LLM Algorithm: Introduces a novel simulation method for social media user opinions, significantly improving accuracy and efficiency by categorizing users into opinion leaders and followers, and integrating LLMs with epidemic models.

  • AgentTorch: A framework that scales ABMs to millions of agents while capturing high-resolution agent behavior using LLMs, demonstrated through a case study on the COVID-19 pandemic.

  • Cognitive Kernel: An open-source agent system designed for generalist autopilots, adopting a model-centric design that facilitates seamless information flow and greater flexibility.

  • LLM-Agent-UMF: Proposes a unified framework for LLM-based agents, addressing terminological and architectural ambiguities and enhancing modularity and integration.

  • Reactive Environments: Introduces a comprehensive paradigm for complex multi-agent communication, facilitating sophisticated interactions and information exchange in nonequilibrium-Steady-State systems.

Sources

Fusing Dynamics Equation: A Social Opinions Prediction Algorithm with LLM-based Agents

Agents in Software Engineering: Survey, Landscape, and Vision

On the limits of agency in agent-based models

Cognitive Kernel: An Open-source Agent System towards Generalist Autopilots

LLM-Agent-UMF: LLM-based Agent Unified Modeling Framework for Seamless Integration of Multi Active/Passive Core-Agents

Reactive Environments for Active Inference Agents with RxEnvironments.jl

Motivations, Challenges, Best Practices, and Benefits for Bots and Conversational Agents in Software Engineering: A Multivocal Literature Review

A Metric Hybrid Planning Approach to Solving Pandemic Planning Problems with Simple SIR Models

Built with on top of