Diffusion-Based Policy Generation for Diverse and Robust Multi-Agent Decision Strategies
DOI:
https://doi.org/10.66525/ijictt76Keywords:
Diffusion models, Policy generation, Reinforcement learning, Exploration, Robust decision-makingAbstract
Policy diversity is critical for avoiding premature convergence in complex decision environments. This study introduces a diffusion-based policy generation framework that models policy distributions instead of deterministic mappings. A conditional diffusion model is trained to generate diverse action candidates, which are subsequently refined through reinforcement learning using a policy selection mechanism. The framework is evaluated on 9,100 decision tasks with high variability, including stochastic planning and adaptive control scenarios. Compared with deterministic policy learning, the proposed method increases exploration coverage by 35.2% and improves final task success rate by 16.8%. Moreover, robustness under environment perturbations improves by 22.4%, as measured by performance variance across test conditions. These results suggest that diffusion-based policy modeling can enhance both diversity and resilience in collaborative systems.
Downloads
References
El‐Taliawi, O. G., & Goyal, N. (2026). The Politics of Policy Robustness: A Central Paradox and Computational Review of Adaptive Policymaking. Public Administration and Development.
Xu, D., Liu, H., Qiu, D., & Ma, Q. (2026). Structured Modeling and Representation Methods for Post-Retrieval Inference Processes in Large Video Language Models.
Chernyavskiy, A., Skrynnik, A., & Panov, A. (2025). Applying opponent and environment modelling in decentralised multi-agent reinforcement learning. Cognitive Systems Research, 89, 101306.
Liu, S., & Yim, J. (2025). Research on Generative AI Creation Systems Based on Visual Language Modeling: Human-Machine Collaboration and Cognitive Feedback Mechanisms. Available at SSRN 6139770.
Reuss, M., Yağmurlu, Ö. E., Wenzel, F., & Lioutikov, R. (2024). Multimodal diffusion transformer: Learning versatile behavior from multimodal goals. arXiv preprint arXiv:2407.05996.
Yue, L., Xu, D., Qiu, D., Shi, Y., Xu, S., & Shah, M. (2025, December). Sequential Cooperative Multi-Agent Online Learning and Adaptive Coordination Control in Dynamic and Uncertain Environments. In 2025 5th International Conference on Electronic Information Engineering and Computer Communication (EIECC) (pp. 692-697). IEEE.
Noarov, G., Ramalingam, R., Roth, A., & Xie, S. (2023). High-dimensional prediction for sequential decision making. arXiv preprint arXiv:2310.17651.
Gao, G., Gao, R., Gao, R., & Zhou, H. (2026). Engineering Analysis and Quantitative Research on the Platform-Based Evolution of Enterprise Communication Systems.
Ada, S. E., Oztop, E., & Ugur, E. (2024). Diffusion policies for out-of-distribution generalization in offline reinforcement learning. IEEE Robotics and Automation Letters, 9(4), 3116-3123.
Xu, D., Gui, H., & Chen, H. (2026). Research on Layered Control and Fault Recovery Mechanisms for Fast Charging Safety Diagnosis of High Voltage Battery Systems Under Charging Network Interoperability Conditions.
Ren, A. Z., Lidard, J., Ankile, L. L., Simeonov, A., Agrawal, P., Majumdar, A., ... & Simchowitz, M. (2024). Diffusion policy policy optimization. arXiv preprint arXiv:2409.00588.
Wang, Y., Chen, J., Wang, Y., & Yin, X. (2026). Application of Obtainable Biological Agent Characteristics in Efficacy Stratification of Oral Anti-Obesity Drugs.
Masud, S. B., Werenski, M., Murphy, J. M., & Aeron, S. (2023). Multivariate soft rank via entropy-regularized optimal transport: Sample efficiency and generative modeling. Journal of Machine Learning Research, 24(160), 1-65.
Zhang, Y., Gu, W., & Wang, J. (2026). Construction of Wind Farm Asset Health Index Based on Multi-Dimensional Indicators and Analytic Hierarchy Process and Its Correlation with Operational Performance. Authorea Preprints.
Hegde, S., Batra, S., Zentner, K. R., & Sukhatme, G. (2023). Generating behaviorally diverse policies with latent diffusion models. Advances in Neural Information Processing Systems, 36, 7541-7554.
Qiu, D., Xu, D., & Yue, L. (2025, December). Reinforcement Learning-Augmented LLM Agents for Collaborative Decision Making and Performance Optimization. In 2025 7th International Conference on Frontier Technologies of Information and Computer (ICFTIC) (pp. 1337-1342). IEEE.
Römer, R., Brunke, L., Schuck, M., & Schoellig, A. P. (2024, April). Safe offline reinforcement learning using trajectory-level diffusion models. In ICRA 2024 Workshop {textemdash} Back to the Future: Robot Learning Going Probabilistic.
Jiao, Y., Wang, A., Zhao, B., & Shi, T. (2026). Quantitative Study on the Construction and Application Effectiveness of Graffiti Wall Painting Teaching Models in Public Space Contexts.
Khanal, A., Ranade, K. T., Agrawal, R., Basu, K. S., & Narayan, A. (2026). Agents of Diffusion: Enhancing Diffusion Language Models with Multi-Agent Reinforcement Learning for Structured Data Generation (Extended Version). arXiv preprint arXiv:2601.07152.
Qiu, Y. (2024). Estimation of tail risk measures in finance: Approaches to extreme value mixture modeling. arXiv preprint arXiv:2407.05933.
Hegde, S., Batra, S., Zentner, K. R., & Sukhatme, G. (2023). Generating behaviorally diverse policies with latent diffusion models. Advances in Neural Information Processing Systems, 36, 7541-7554.
Xu, D., Chen, H., & Gui, H. (2026). Unified Online Estimation Method for SOC, SOH, and Power Capacity Considering Safety Boundary Consistency in Battery Management Systems.
Ningkai, H. (2025). DIME: Unifying Diffusion Models and Maximum Entropy Reinforcement Learning for Expressive Policy Representation. Journal of Technology Innovation and Engineering, 1(6).
Wang, Y., Chen, J., Wang, Y., & Yin, X. (2026). Application of Obtainable Biological Agent Characteristics in Efficacy Stratification of Oral Anti-Obesity Drugs.
Ahmad, N. R. (2025). Exploring the role of digital technologies in enhancing supply chain efficiency: A case study of e-commerce companies. Indus Journal of Social Sciences, 3(1), 226–237. https://doi.org/10.59075/ijss.v3i1.618
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Oliver Brown, Thomas A. Walker, James Wilson (Author)

This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in the International Journal of Information and Communication Technology Trends (IJICTT) are distributed under a Creative Commons license. This allows readers to freely access, share, and adapt the content for non-commercial purposes, provided proper attribution is given to the original authors. Authors retain copyright of their work.
