Cloud data centers used for High Performance Computing (HPC) with volatile Internet of Things (IoT) devices absolutely requires zero-speed switching/low latency, normalized throughput, network stability with near zero packet drops during heavy traffic workload. Deadlock traffic condition found in baseline Fog-nodes results when there is no dynamic provisioning of services at Fog layer. In this case, Quality of Service (QoS) metrics of Service Level Agreements (SLA) are violated. Motivated by these concerns, this paper proposes Smart Hierarchical Network (SHN) as a reliable Fog dynamic design structure based on Software Defined Artificial Neural Network (SD-ANN). It features congestion-aware neural switch model with embedded predictive receding horizon for intelligent congestion management. The goal is to exploit the locally optimized Fog neural switch connections and maximize the overall QoS while satisfying the enormous traffic workload requirements. A sampled real-world trace-file workload from Galaxy backbone, Nigeria, is compared with SHN for Fog service provisioning. It is shown that with receding horizon, the ANN-based model ideally offers 100% throughput R value. Under the established training scenarios, the ANN switch offers the lowest mean square error while yielding acceptable QoS metrics. The result is significant for scalable networks supporting massive computational workloads.