On-the-Fly Homographies Calibration for Multi-Camera Tracking
This research is relevant for developers working on multi-camera systems, as it provides a solution to a common operational barrier.
This paper presents a system for multi-camera tracking that overcomes the need for traditional 3D site calibration.
It uses a centroid-based projection optimization (PO) to continuously align the ground-plane geometry using live detection streams, starting from coarse manual homographies.
This allows the system to adapt automatically to camera movements or environmental changes without human intervention, ensuring privacy-safe tracking in dynamic environments.
Precise multi-camera tracking traditionally relies on rigorous 3D site calibration, yet this requirement is often operationally impossible in large-scale deployments. Privacy regulations frequently prohibit recording video for offline calibration; limited bandwidth precludes synchronizing high-resolution streams from hundreds of cameras; and covering immense physical sites with calibration targets is logistically infeasible. We present a multi-camera homography calibration system designed to overcome these barriers through "on-the-fly" geometric refinement. Starting from coarse manual homographies, we introduce a centroid-based projection optimization (PO) that continuously aligns the ground-plane geometry using live detection streams. Because PO operates asynchronously on already-transmitted, lightweight metadata, it adds zero computational latency to the real-time tracker. This allows the system to adapt automatically to camera movements or environmental changes without human intervention. This optimized geometry feeds a multi-camera bird's-eye-view (BEV) tracker that fuses detections and unifies trajectories across zones. Crucially, by operating strictly on live anonymous metadata, our solution ensures a privacy-safe, zero-overhead, and resilient tracking pipeline that maintains global consistency in dynamic environments where static, recorded-video calibration is impossible.
This report is categorized under AITOP's "Papers" desk, focusing on Europe's AI governance and technology ecosystem. Key entities and technical topics under continuous tracking include real-time tracking.
Source attribution: curated from arXiv cs.AI (@David Voihanski, Mor Sinai, Ben Zion Bobrovsky).