When to Measure: A Multi-Agent Reinforcement Learning Approach for Efficient Tracking
Alessandro Amato, Raffaele Galliera, K. Brent Venable and Niranjan Suri
Proceedings of the International Florida Artificial Intelligence Research Society Conference, Vol.39(1)
Annual Meeting of the Florida Artificial Intelligence Research Society, 39th (Marco Island, Florida, USA, 05/2026)
05/2026
Metrics
1 Record Views
Abstract
Cooperative Target Tracking Graph Neural Networks Hierarchical Coordination Maritime Patrol Scenario Multi-Agent Reinforcement Learning Unmanned Aerial Vehicles Control Systems Intelligent Agents or Systems Machine Learning
Autonomous multi-agent systems face significant challenges due to the computational inefficiencies of centralized control methods. As a result, distributed approaches have gained increasing attention, enabling decentralized decision-making when a single control point is undesirable or impractical. In the context of disaster-response, one prominent application is cooperative target tracking with Unmanned Aerial Vehicles (UAVs), where multiple UAVs must coordinate to monitor ground targets and ensure that no target remains unobserved for extended periods of time. In this paper, we formalize the multi-agent target tracking problem and introduce a scalable Multi-Agent Reinforcement Learning (MARL) training environment for cooperative UAV swarm tracking. Each agent is equipped with a set of independent Kalman filters (KFs) and must coordinate with other agents to maintain continuous tracking of multiple ground targets. We propose a MARL-based approach to address this problem and provide a detailed experimental evaluation between state-of-the-art on-policy and off-policy algorithms. The results demonstrate the effectiveness and scalability of MARL approaches for decentralized cooperative tracking in complex and dynamic environments.