Many cooperative multi-agent tasks are naturally defined by graph-structured objectives, where agents must collectively achieve a desired relational configuration or satisfy a set of constraints. However, current goal-conditioned multi-agent reinforcement learning (MARL) methods rarely leverage such symbolic structure to guide learning. To address this challenge, we propose Graph Embeddings for Multi-Agent Coordination (GEMA), which augments any cooperative learner with a State-Graph Encoder (SGE). The SGE is pre-trained contrastively to embed state and goal graphs in a shared metric space. At run time, each agent constructs the state graph, queries the SGE, and computes a similarity score to the goal embedding. This similarity serves as an intrinsic reward, providing dense feedback on task progress, and is also incorporated into each agent's observation. Experiments on cooperative navigation, load balancing, and the StarCraft Multi-Agent Challenge (v2) show that GEMA accelerates convergence and improves team returns.
Related links
Details
Title
Encoding Goals as Graphs
Publication Details
Proc. of the 25th International Conference on Autonomous Agents and Multiagent Systems, pp.3513-3515