AI and LLMs in Software Development

Current Developments in the Research Area

The recent advancements in the research area reflect a significant shift towards leveraging artificial intelligence (AI) and large language models (LLMs) to enhance various aspects of scientific research, software development, and human-computer interaction. The field is moving towards more integrated, automated, and user-friendly solutions that democratize access to complex tools and data, while also addressing the challenges of scalability, efficiency, and user engagement.

General Direction

  1. Democratization of Complex Tools and Data: There is a growing emphasis on making advanced research tools and vast datasets accessible to a broader audience. This includes creating user-friendly interfaces and sandboxed environments that lower the barrier to entry for non-experts, such as the introduction of beginner's kits for accessing extensive research databases.

  2. Integration of AI in Software Development: The role of AI in software development is expanding beyond code generation to include the development of prompts and the creation of AI-driven software pipelines. This trend is characterized by the emergence of new methodologies like prompt programming, which treat prompts as programs, and the development of AI agents that assist in generating and evaluating LLM pipelines.

  3. Enhanced Human-Computer Interaction: Innovations in human-computer interaction are focusing on making interfaces more intuitive and responsive. This includes the use of virtual reality (VR) for cognitive tasks, the automation of design feedback for visualization, and the creation of multi-modal interaction tools that combine voice, text, and visual inputs.

  4. Automation and Efficiency in Research Processes: There is a push towards automating various stages of the research process, from ideation and data analysis to the creation of standardized documentation. This is being driven by the development of AI-based systems that can generate hypotheses, create scientific agents, and automate the creation of research resource databases.

  5. Ethical Considerations and Transparency: As AI tools become more integrated into research and development, there is an increasing focus on ethical considerations, including the potential for over-reliance on AI, cognitive biases, and the need for transparency in data usage. Researchers are exploring ways to mitigate these risks while still leveraging the power of AI.

Noteworthy Papers

  1. "Prompts Are Programs Too! Understanding How Developers Build Software Containing Prompts": This paper introduces the concept of prompt programming, highlighting its distinct nature from traditional software development and suggesting the need for new tools to support this emerging field.

  2. "A Cognitive Approach to Improving Binary Reverse Engineering with Immersive Virtual Reality": This work demonstrates the potential of VR in enhancing cognitive tasks, providing a novel approach to reverse engineering binary programs through immersive affordances.

  3. "Visualizationary: Automating Design Feedback for Visualization Designers using LLMs": This paper explores the use of LLMs to provide actionable feedback to visualization designers, showcasing a tool that aids even seasoned designers in refining their visualizations.

  4. "PersonaFlow: Boosting Research Ideation with LLM-Simulated Expert Personas": Introducing PersonaFlow, this study highlights the benefits of using LLM-simulated expert personas to enhance interdisciplinary research ideation, while also addressing ethical concerns related to over-reliance on AI.

  5. "TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning": This paper presents a novel reinforcement learning-based method for task-aware prompt compression, demonstrating significant improvements in task performance across various scenarios.

These papers represent some of the most innovative and impactful contributions to the field, pushing the boundaries of what is possible with AI and LLMs in research, development, and human-computer interaction.

Sources

Exploring Scientometrics with the OpenAIRE Graph: Introducing the OpenAIRE Beginner's Kit

Prompts Are Programs Too! Understanding How Developers Build Software Containing Prompts

A Cognitive Approach to Improving Binary Reverse Engineering with Immersive Virtual Reality

Visualizationary: Automating Design Feedback for Visualization Designers using LLMs

PersonaFlow: Boosting Research Ideation with LLM-Simulated Expert Personas

FoodPuzzle: Developing Large Language Model Agents as Flavor Scientists

TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning

Towards Nudging in BPM: A Human-Centric Approach for Sustainable Business Processes

Exploring Actions, Interactions and Challenges in Software Modelling Tasks: An Empirical Investigation with Students

MapCraft: Dissecting and Designing Custom Geo-Infographics

Misty: UI Prototyping Through Interactive Conceptual Blending

ChainBuddy: An AI Agent System for Generating LLM Pipelines

Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Experts

CI-Bench: Benchmarking Contextual Integrity of AI Assistants on Synthetic Data

RRD-Bio: Building An Integrated Research Resource Database for Biomedicine

An Instance-based Plus Ensemble Learning Method for Classification of Scientific Papers

LADICA: A Large Shared Display Interface for Generative AI Cognitive Assistance in Co-Located Team Collaboration

Exploring Automated Keyword Mnemonics Generation with Large Language Models via Overgenerate-and-Rank

The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trends

Chattronics: using GPTs to assist in the design of data acquisition systems

LLMs' ways of seeing User Personas

Immersed in my Ideas: Using Virtual Reality and Multimodal Interactions to Visualize Users' Ideas and Thoughts

Workspace Awareness Needs in Mixed-Presence Collaboration on Wall-Sized Displays

EvAlignUX: Advancing UX Research through LLM-Supported Exploration of Evaluation Metrics

Persona-L has Entered the Chat: Leveraging LLM and Ability-based Framework for Personas of People with Complex Needs

Towards a Realistic Long-Term Benchmark for Open-Web Research Agents

Scideator: Human-LLM Scientific Idea Generation Grounded in Research-Paper Facet Recombination

Learning from Contrastive Prompts: Automated Optimization and Adaptation

Parse Trees Guided LLM Prompt Compression

Enhancing Scientific Reproducibility Through Automated BioCompute Object Creation Using Retrieval-Augmented Generation from Publications

Steward: Natural Language Web Automation

Self-Elicitation of Requirements with Automated GUI Prototyping

PolicyCraft: Supporting Collaborative and Participatory Policy Design through Case-Grounded Deliberation

Task-oriented Prompt Enhancement via Script Generation

Automated test generation to evaluate tool-augmented LLMs as conversational AI agents

Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale

Spacewalker: Traversing Representation Spaces for Fast Interactive Exploration and Annotation of Unstructured Data

Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publications

Textoshop: Interactions Inspired by Drawing Software to Facilitate Text Editing

Turn Every Application into an Agent: Towards Efficient Human-Agent-Computer Interaction with API-First LLM-Based Agents

Built with on top of