Evidence-Density Adaptive Retrieval for Few-Label Multimodal Entity Extraction

Authors

  • Thandi Swanepoel Department Mechanical and Mechatronic Engineering, Faculty of Engineering, Stellenbosch University, Stellenbosch, Western Cape, South Africa Author

DOI:

https://doi.org/10.66525/ijictt116

Keywords:

Multimodal Entity Extraction, Adaptive Retrieval, Few-Label Learning, Evidence Density

Abstract

The rapid proliferation of multimedia content across digital platforms has necessitated the development of advanced information extraction systems capable of processing heterogeneous data streams. Multimodal Entity Extraction represents a critical task in this domain, aiming to identify and categorize entities by simultaneously interpreting text and associated visual or auditory signals. However, existing architectures heavily rely on large-scale annotated datasets, rendering them impractical for specialized domains where labeling is prohibitively expensive. Furthermore, current retrieval-augmented approaches apply a static retrieval strategy regardless of the inherent informational completeness of the input, leading to computational inefficiency and semantic noise. To address these limitations, this paper introduces an Evidence-Density Adaptive Retrieval framework designed specifically for few-label Multimodal Entity Extraction. By conceptually quantifying the informational density of intrinsic multimodal evidence, the proposed system dynamically determines the necessity, scope, and modality of external knowledge retrieval. The architecture leverages a dual-stream encoder aligned through a contrastive objective, coupled with a density estimation module that computes the semantic saturation of the input. We evaluate the proposed methodology across multiple benchmark datasets under strictly constrained few-label settings. The empirical results demonstrate that our adaptive approach significantly outperforms static retrieval baselines in both extraction accuracy and computational efficiency, mitigating the introduction of extraneous noise while maximizing the utility of a limited demonstration memory bank.

Downloads

Download data is not yet available.

References

1. Zhao, R., Tang, J., Zeng, W., Chen, Z., & Zhao, X. (2024, October). Zero-shot knowledge graph question generation via multi-agent llms and small models synthesis. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management (pp. 3341-3351).

2. Mo, Z. A Study on Chinese-English Bilingual Question Answering Systems Using Cross-Lingual Pre-Trained Models. October 2025. Image Processing, Electronics and Computers, DOI, 10.

3. Wang, L., Shi, C., Du, S., Tao, Y., Shen, Y., Zheng, H., & Qiu, X. (2024, December). Performance Review on LLM for solving leetcode problems. In 2024 4th International Symposium on Artificial Intelligence and Intelligent Manufacturing (AIIM) (pp. 1050-1054). IEEE.

4. Sang, Y. (2025, October). AutoCrit: A Meta-Reasoning Framework for Self-Critique and Iterative Error Correction in LLM Chains-of-Thought. In 2025 6th International Conference on Machine Learning and Computer Application (ICMLCA) (pp. 1177-1180). IEEE.

5. Tang, J., Wang, Z., Gong, Z., Yu, J., Zhu, X., & Yin, J. (2025, April). Multi-grained query-guided set prediction network for grounded multimodal named entity recognition. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 39, No. 24, pp. 25246-25254).

6. Tang, J., Yang, Y., Yu, J., Wang, Z. X., Liang, H., Yao, L., & Yin, J. (2025, November). Unco: Uncertainty-driven collaborative framework of large and small models for grounded multimodal ner. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing (pp. 7644-7662).

7. Su, Yiyun, et al. "Agentic-SQL Taxonomy: A Survey of Autonomous and Interactive Text-to-SQL with LLMs." (2026).

8. Zhu, D., Xie, C., Zhang, H., Wei, Z., Wang, Z., Shi, J., ... & Xie, Q. (2026). Standalone LLM and a Pre-specified Agentic Pipeline for Explaining ICU Mortality Predictions: a Feasibility Study on the eICU Demo Dataset. arXiv preprint arXiv:2608.26109.

9. Qiu, Z., Qiu, K., Lyu, H., Xiong, W., & Luo, J. (2024, December). Semantics preserving emoji recommendation with large language models. In 2024 IEEE International Conference on Big Data (BigData) (pp. 7131-7140). IEEE.

10. Wang, Z. (2026). StreamReason-Bench: Can Large Language Models Reason about Event-Time Stream-Processing Semantics?. arXiv preprint arXiv:2608.12348.

11. Pennington, J., Socher, R., & Manning, C. D. (2014). GloVe: Global vectors for word representation. In Proceedings of EMNLP.

12. Rafailov, R., Sharma, A., Mitchell, E., Manning, C. D., Ermon, S., & Finn, C. (2024). Direct preference optimization: Your language model is secretly a reward model. In Advances in Neural Information Processing Systems.

13. Li, Q., Ye, Q., Zhang, N., Zhang, W., & Hu, F. (2025). Digital-twin-enabled industrial IoT: Vision, framework, and future directions. IEEE Wireless Communications, 32(6), 173-181.

14. Li, S. (2025). Momentum, volume and investor sentiment study for us technology sector stocks—A hidden markov model based principal component analysis. PloS one, 20(9), e0331658.

15. Zhang, B., Wang, S., Jiang, Y., Sui, D., Tu, Z., & Chu, D. (2025, July). Ask and Retrieve Knowledge: Towards Proactive Asking with Imperfect Information in Medical Multi-turn Dialogues. In Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1055-1065).

16. Li, S. (2024). Machine Learning in Credit Risk Forecasting — — A Survey on Credit Risk Exposure. Accounting and Finance Research, 13(2), 107-107.

17. Wang, Z., Yuan, R., Geng, Z., Li, H., Qu, X., Li, X., ... & Zhang, K. (2025, October). Singing timbre popularity assessment based on multimodal large foundation model. In Proceedings of the 33rd ACM International Conference on Multimedia (pp. 12227-12236).

18. Jin, H., Tsai, F. S., & Martinez-Vazquez, J. (2025). Optimal expenditure decentralization for sustainable development: evidence from a 52-country panel analysis. Financial Innovation, 11(1), 111.

19. Zhang, Y., Qiu, C., Liao, X., & Zhang, Y. (2025). Federated hierarchical clustering with automatic selection of optimal cluster numbers. Information Sciences, 122957.

20. Zhu, R., Jiang, B., Mei, L., Yang, F., Wang, L., Gao, H., ... & Zhang, D. (2025). Adaptflow: Adaptive workflow optimization via meta-learning. arXiv preprint arXiv:2508.08053.

Downloads

Published

2026-08-22