Object-Centric Industrial Video Anomaly Detection with Local-Global Representation Learning

Authors

  • Chun-Wai So Faculty of Computer Science Department, Huazhong University of Science and Technology, Wuhan 430074, China Author
  • Man-Kit Chau School of Computer Science, Peking University, Beijing 100871, China Author

DOI:

https://doi.org/10.66525/ijictt109

Keywords:

Video Anomaly Detection, Object-Centric Learning, Representation Learning, Industrial Surveillance, Computer Vision

Abstract

Industrial video anomaly detection is a critical component of modern smart manufacturing and industrial surveillance, aiming to automatically identify deviations from normal operational patterns. Traditional methods relying on frame-level or pixel-level feature extraction often struggle with the complex, dynamic, and heavily occluded environments typical of industrial settings. This paper proposes a novel framework centered on object-centric video anomaly detection, heavily augmented by a local-global representation learning mechanism. By shifting the analytical focus from the entire image frame to specific objects of interest, such as machinery components, manufactured goods, and human operators, the proposed method isolates highly relevant features while mitigating the impact of background noise and illumination variations. The framework utilizes a robust tracking-by-detection paradigm to construct spatio-temporal object tubes, which are subsequently processed to extract localized representations capturing appearance and motion dynamics. Concurrently, a global representation module employs attention mechanisms to model the complex interactions between multiple objects and their contextual environment. The integration of these local and global streams ensures a comprehensive understanding of the industrial scene, allowing for the precise localization and classification of anomalous events. Extensive evaluations on multiple large-scale industrial datasets demonstrate that the proposed object-centric framework significantly outperforms existing state-of-the-art approaches in both anomaly detection accuracy and computational efficiency. The findings suggest that integrating structured object interactions into representation learning provides a highly scalable and robust solution for real-world industrial monitoring. 

Downloads

Download data is not yet available.

References

1. Qu, W., Wang, J., Gong, Y., Huang, X., & Xiao, L. (2025, June). An end-to-end robust point cloud semantic segmentation network with single-step conditional diffusion models. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 27325-27335). IEEE.

2. Li, X., Yang, F., Chen, L., & Cai, H. (2016, July). Saliency transfer: An example-based method for salient object detection. In IJCAI (pp. 3411-3417).

3. Zhang, Y., Zhang, Y., Wu, H., Liu, Z., Zang, R., Zhu, X.,... & Ma, F. (2026). Be Faithful When Response: Returning Fluent and Grounded Answers for Vision-Language Models Reinforcement Learning. arXiv preprint arXiv:2606.29984.

4. Chen, L., Yang, Y., & Zhang, S. (2025). Auto-focusing and auto-exposure method for real-time structured-light 3D imaging.Optical Engineering,64(4), 044105-044105.

5. Ou, L., Liu, Y., Li, Z., Bai, X., & Peng, Y. (2026, March). Structure-Grounded Training Strategies Aid Generalization in Stereo Matching. In 2026 International Conference on 3D Vision (3DV) (pp. 125-134). IEEE.

6. Xia, Y., Ye, T., Huang, J., Mei, X., & Ma, J. (2026, March). Probabilistic deformation consistency for unsupervised shape matching. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 40, No. 13, pp. 10951-10959).

7. Li, Q., Luo, T., Jiang, M., Liao, J., & Jiang, Z. (2024, October). Deep incomplete multi-view network semi-supervised multi-label learning with unbiased loss. In Proceedings of the 32nd ACM International Conference on Multimedia (pp. 9048-9056).

8. Xia, Y., Lu, Y., Gao, Y., & Ma, J. (2024, March). Locality preserving refinement for shape matching with functional maps. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 38, No. 6, pp. 6207-6215).

9. Qi, Z., Wang, S., Zhang, W., & Huang, Q. (2024). Uncertainty-boosted robust video activity anticipation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(12), 7775-7792.

10. Wang, H., Que, H., Xu, Q., Liu, M., Zhou, W., Feng, J., ... & Lin, F. (2026, April). Reverse-engineered reasoning for open-ended generation. In International Conference on Learning Representations (Vol. 2026, pp. 45563-45589).

11. Zhang J, Luo H, Yang H, et al. Neuraldome: A neural modeling pipeline on multi-view human-object interactions[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2023: 8834-8845.

12. Peng, Qucheng, et al. "3d vision-language gaussian splatting." International Conference on Learning Representations. Vol. 2025. 2025.

13. Zhou, Yufan, et al. "Masked Temporal Interpolation Diffusion for Procedure Planning in Instructional Videos." arXiv preprint arXiv:2507.03393 (2025).

14. Huang, H., Zhang, J., Zhang, J., Xu, J., & Wu, Q. (2020). Low-rank pairwise alignment bilinear network for few-shot fine-grained image classification.IEEE Transactions on Multimedia,23, 1666-1680.

15. Liu, C., Ma, L., Zhang, X. T., Zhang, Y., Zhang, H., Yang, X., & Tian, F. (2026). Boosting omni-modal language models: Staged post-training with visually debiased evaluation. arXiv preprint arXiv:2605.12034.

16. Qu, D., & Ma, Y. (2026). Fourier–Transformer Mixer Network for Efficient Video Scene Graph Prediction.Engineering Proceedings,120(1), 16.

17. Girshick, R. (2015). Fast R-CNN. In Proceedings of ICCV.

18. Wang, H., Feng, W., Yu, J., Liu, C., Nie, P., Lin, F., ... & Wei, C. (2026). Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation.arXiv preprint arXiv:2607.05382.

19. Yang, Y., & Zhang, S. (2024). Pixelwise calibration method for a telecentric structured light system.Applied Optics,63(10), 2562-2569.

20. Li, Z., Jiang, L., Zhao, Y., Chen, Y. C., Wang, X., Chen, W., & Peng, Y. (2026). PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments. arXiv preprint arXiv:2606.24564.

21. Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., et al. (2022). Flamingo: a visual language model for few-shot learning. In Advances in Neural Information Processing Systems.

22. Cong, P., Xu, Y., Ren, Y., Zhang, J., Xu, L., Wang, J., ... & Ma, Y. (2023, June). Weakly supervised 3d multi-person pose estimation for large-scale scenes based on monocular camera and single lidar. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 37, No. 1, pp. 461-469).

23. Li, Q., Luo, T., Jiang, M., Jiang, Z., Hou, C., & Li, F. (2025, April). Semi-supervised multi-view multi-label learning with view-specific transformer and enhanced pseudo-label. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 39, No. 17, pp. 18430-18438).

24. Li, J., Shuang, K., Guo, J., Shi, Z., & Wang, H. (2023). Enhancing semantic relation classification with shortest dependency path reasoning. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31, 1550-1560.

25. Lee, Y., Gao, P., Xu, Y., & Fan, W. (2025, October). How Do Optical Flow and Textual Prompts Collaborate to Assist in Audio-Visual Semantic Segmentation?. In 2025 IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 23342-23352). IEEE.

26. Chen, L., Jiang, X., Liu, X., & Zhou, Z. (2020). Robust low-rank tensor recovery via nonconvex singular value minimization. IEEE Transactions on Image Processing, 29, 9044-9059.

27. Xia, Y., & Ma, J. (2022). Locality-guided global-preserving optimization for robust feature matching.IEEE Transactions on Image Processing,31, 5093-5108.

Downloads

Published

2026-08-06