CORTEXA
← Browse
arxivcs.NIcs.AI2026-07-20

Human Grounded Evaluation of Large Language Models for Optical Network Automation

Kiarash Rezaei, Omran Ayoub, Paolo Monti, Carlos Natalino

Large language models (LLMs) are increasingly adopted for network automation, yet their output quality and inference cost can vary substantially across LLM families. We present HuGLEN, a stepwise evaluation pipeline that uses an LLM-as-a-judge together with a small set of expert ratings to enable scalable and reproducible comparison of candidate LLMs, and to rank them using a quality efficiency score (QES). We demonstrate HuGLEN for translating outputs from an explainable artificial intelligence (XAI) model for the optical network quality of transmission (QoT) estimation task into operator-friendly explanations. Our results show that a medium-sized LLM (12B parameters) achieves the highest QES, indicating the best trade-off between explanation quality and efficiency. Overall, HuGLEN reduces the human-labeling burden while supporting consistent model selection for operator-facing automation tasks.

View free PDFSource page

Related papers

arxivcs.NIcs.AI2026-07-05

Agentic-V2X: Small Language Model Agents for Deadline-Aware V2X Scheduling in 5G/6G Networks

Gerasimos Papanikolaou-Ntais, Alexandros Kaloxylos, Athanasios Kanavos

Large Language Models (LLMs) are proposed as control interfaces for next-generation networks, but their latency, hallucinations, and lack of control guarantees make them unsuitable for near-real-time packet schedulers, especially in dynamic V2X environments. This paper introduces…

View free PDFSource page
arxivcs.NIcs.AIeess.SPeess.SY2026-07-07

Agentic AI for IPoDWDM Network Lifecycle Automation: An MCP-Enabled Architecture

Chunmin Xia, Jakub Harbaczewski, Nikhil Dsilva, Julie Raulin, Dominic Schneider, Achim Autenrieth

We present a distributed, vendor-agnostic multi-MCP architecture for SDN-based automation and autonomous control of multi-vendor, multi-layer IPoDWDM networks. The framework enables E2E service lifecycle automation, closed-loop cross-layer control using GNPy model and optical tel…

View free PDFSource page
arxivcs.NIcs.AIcs.MAeess.SY2026-07-07

MCP-Enabled Agentic AI for Autonomous IPoDWDM Network Lifecycle Automation

Chunmin Xia, Jakub Harbaczewski, Nikhil Dsilva, Julie Raulin, Dominic Schneider, Achim Autenrieth

This demo presents an MCP-enabled agentic AI architecture for autonomous control of vendor-agnostic IPoDWDM networks. We demonstrate live end-to-end lifecycle multi-layer automation and closed-loop control using GNPy and telemetry, validated on a real testbed.

View free PDFSource page
arxivcs.LGcs.AIcs.DCcs.MAcs.NI2026-07-13

PFAdapter: Hierarchical LoRA Decomposition for Personalized Federated MLLMs

Jing Liu, Kun Yang, Yan Wang, Dingkang Yang, Xiaoshuai Hao, Wei Zhang, et al.

Agentic AI systems are reshaping communications and networking by deploying autonomous intelligent agents capable of collaborative learning while maintaining data privacy at network edges. Within distributed network environments, Multimodal Large Language Models (MLLMs) serve as…

View free PDFSource page