Logo image
GEMA: Graph Embeddings for Multi‐Agent Coordination
Journal article   Open access   Peer reviewed

GEMA: Graph Embeddings for Multi‐Agent Coordination

Alessandro Amato, Raffaele Galliera, K. Brent Venable and Niranjan Suri
The AI magazine, Vol.47(3), e70088
09/2026
Web of Science ID: WOS:001856320300001

Metrics

1 Record Views

Abstract

Agents Benchmarks Coordination Markov analysis Marl Objectives Scalarity (Semantics) Artificial Intelligence or Cybernetics Intelligent Agents or Systems Machine Learning
Many cooperative multi‐agent tasks are naturally defined by graph‐structured objectives, where agents must collectively reach, for example, a desired relational configuration or satisfy a set of constraints. These objectives often encode spatial arrangements, inter‐agent relations, or constraints that can be formalized as target graphs. However, current goal‐conditioned multi‐agent reinforcement learning (MARL) algorithms do not employ these symbolic and structured representations to direct their agents towards effective strategies. We propose Graph Embeddings for Multi‐Agent Coordination (GEMA), which couples any cooperative learner with a State‐Goal Graph Encoder (SGE). The SGE is pre‐trained in a contrastive manner to embed state graphs in a common metric space. At run time, each agent builds the state graph, queries the SGE, and computes a scalar distance to the goal embedding. The calculated distance can then be used as an intrinsic reward signal for the agents and incorporated into each agent's observation, providing feedback on the task progress. Experiments on challenging benchmarks for centralized training with decentralized execution (CTDE), including cooperative navigation, load balancing, and the StarCraft Multi‐Agent Challenge (v2), demonstrate that GEMA accelerates convergence and improves team returns, outperforming both standard and objective‐driven state‐of‐the‐art MARL baselines. Code repository: .
url
GEMA: Graph Embeddings for Multi-Agent CoordinationView
Published (Version of record) link to article Open CC BY V4.0
url
aamatodev / gema PublicView
Code/Script link to code Open

Related links

Details

Logo image