Neural and Evolutionary Computing
See recent articles
Showing new listings for Thursday, 2 July 2026
- [1] arXiv:2607.00286 [pdf, html, other]
-
Title: Self-Organized Learning in Oscillatory Neural Networks with Memristive Signed CouplingsComments: 14 pages single columnSubjects: Neural and Evolutionary Computing (cs.NE); Machine Learning (cs.LG); Adaptation and Self-Organizing Systems (nlin.AO)
Oscillatory neural networks (ONNs) have emerged as a promising neuromorphic architecture, leveraging coupled dynamical systems to perform computation and represent information through phase relationships. Their interactions can be designed to support intrinsic energy-minimizing dynamics, enabling tasks such as associative memory and optimization, and positioning them as a candidate architecture for continuous learning and inference. We present a neuromorphic primitive implemented using memristive edges with inhibitory couplings as a potential design for autonomous learning, and provide circuit simulation validation that the system is capable of denoising noisy inputs on an auto-associative task. While numerical Hopfield/Ising models routinely assume signed weights, neuromorphic implementations of ONNs often fail to realize negative weights due to device and circuit constraints. A practically implementable route to inhibitory (negative) weights is particularly valuable: it expands the class of attractor structures accessible to oscillator networks beyond purely synchronous couplings, and supports phase-coded memories where anti-phase constraints are not merely transiently enforced during training but can persist autonomously after release. We provide circuit simulations and theoretical analyses demonstrating that signed effective weights are necessary for anti-phase attractors to persist autonomously.
- [2] arXiv:2607.00761 [pdf, html, other]
-
Title: From Consistency to Collaborative Discovery: MFEA-CoD for Multitask Novelty SearchSubjects: Neural and Evolutionary Computing (cs.NE)
Evolutionary multitasking (EMT) has shown strong capability in solving multiple optimization problems simultaneously by exploiting latent inter-task consistency, such as similarities in promising solutions or search directions. However, most existing EMT studies remain focused on objective-driven optimization, where such consistency is mainly used to accelerate convergence toward predefined optima. In this paper, we move EMT from consistency to collaborative discovery and propose a multifactorial evolutionary algorithm with collaborative discovery (MFEA-CoD) for multitask novelty search. Unlike conventional EMT, MFEA-CoD coordinates multiple novelty search tasks to collaboratively discover behaviorally novel solutions rather than merely transferring consistent search information for faster convergence. Specifically, a multitask repulsion operator encourages different tasks to explore distinct regions of the unified search space, thereby reducing redundant behavioral discoveries. Meanwhile, an adaptive inter-task transfer mechanism exploits shared discovery opportunities in overlapping novelty-improving regions by adjusting the transfer probability according to the online contribution of transferred information. Furthermore, MFEA-CoD is extended to multitask novelty-augmented optimization, where behavioral novelty is jointly considered with objective information to alleviate premature convergence caused by deceptive objectives. Experiments on synthetic basin-type problems, deceptive maze navigation problems, MuJoCo policy optimization problems, and generative novelty search problems demonstrate that MFEA-CoD improves the efficiency of discovering diverse novel solutions and shows clear advantages in deceptive objective landscapes.
- [3] arXiv:2607.00846 [pdf, html, other]
-
Title: MMAO-Dyn: A Metabolic Multi-Agent Optimizer for Dynamic OptimizationSubjects: Neural and Evolutionary Computing (cs.NE)
This paper studies whether the Metabolic Multi-Agent Optimizer (MMAO) can be credibly derived into a dynamic-optimization method without replacing its core metabolic control loop by external adaptation modules. The proposed MMAO-Dyn maps private energy, communal budget, role drift, success feedback, and lifecycle turnover to a nonstationary setting in which environmental changes repeatedly invalidate previously useful local structure. We evaluate MMAO-Dyn on an 18-scenario synthetic dynamic continuous benchmark matrix covering shifted sphere, shifted Ackley, and shifted Rastrigin landscapes at 10ドルD,ドル 20ドルD,ドル and 30ドルD,ドル with two change severities and 12 seeds per scenario. The comparison layer includes a generic MMAO variant without dynamic derivation, dynamic random search, dynamic PSO-lite, dynamic DE-lite, and three endogenous ablations. Across the full 216-run matrix, MMAO-Dyn attains mean offline error 28ドル.07,ドル improving over Generic-MMAO (29ドル.36$), Dynamic-PSO-lite (34ドル.65$), Dynamic-DE-lite (67ドル.09$), and Dynamic-RandomSearch (111ドル.37$). The gains are clearest in aggregate robustness on sphere and Rastrigin families and in 10-step post-change recovery relative to the generic backbone, whereas the seed-aligned comparison with Dynamic-PSO-lite remains unfavorable in win-loss count and the \texttt{NoMemoryRefresh} ablation stays very close to the full method. We therefore position MMAO-Dyn as a credible family-expansion result for MMAO: the metabolic loop can generate meaningful dynamic behavior, but the strongest current value lies in recovery-oriented resource redistribution rather than in universal dominance or in a fully optimized submechanism design.
New submissions (showing 3 of 3 entries)
- [4] arXiv:2607.00154 (cross-list from cs.LG) [pdf, html, other]
-
Title: EVOTS: Evolutionary Transformer Search for Time Series ForecastingSubjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)
Evolutionary neural architecture design for multivariate time-series forecasting remains underexplored, with most approaches relying on fixed Transformer architectures despite substantial variation across tasks and forecasting settings. This paper introduces an evolutionary neural architecture search framework for discovering task-adaptive Transformer-like models for time-series forecasting (EVOTS). Architectures are encoded using a modular genome representation that enables flexible composition of attention, feed-forward, and projection components, while a repair mechanism enforces structural validity throughout the evolutionary process. This formulation allows effective exploration of a diverse architecture space without relying on hand-crafted design rules. The proposed approach is evaluated on four benchmark datasets from the ETT family (ETTh1, ETTh2, ETTm1, and ETTm2) under multiple forecasting settings, including univariate-to-univariate, multivariate-to-univariate, and multivariate-to-multivariate prediction, with horizons of 96, 192, 336, and 720. In the multivariate-to-multivariate setting, the evolved architectures achieve competitive and, in several cases, improved mean squared error relative to a strong Transformer-based baseline. Additional analyses examine performance differences across forecasting settings and report wall-clock training time to provide a coarse indication of computational cost. Overall, the results demonstrate that evolutionary search can effectively discover flexible and high-performing Transformer-like architectures for multivariate time-series forecasting within practical runtime constraints.
Cross submissions (showing 1 of 1 entries)
- [5] arXiv:2604.21468 (replaced) [pdf, html, other]
-
Title: Novelty-Based Generation of Continuous Landscapes with Diverse Local Optima NetworksComments: Accepted for publication at PPSN 2026 (LNCS, Springer). The final authenticated version will be available online at Springer via DOI (to be added upon publication)Subjects: Neural and Evolutionary Computing (cs.NE)
Local Optima Networks (LONs) represent the global structure of search spaces as graphs, but their construction requires iterative execution of a search algorithm to find local optima and approximate transitions between Basins of Attraction (BoAs). In continuous optimization, this high computational cost prevents systematic investigation of the relationship between LON features and evolutionary algorithm performance. To address this issue, we propose an alternative definition of BoAs for Max-Set of Gaussians (MSG) landscapes with explicitly tunable multimodality. This bypasses search-based BoA identification, enabling low-cost LON construction. Moreover, we leverage Novelty Search (NS) to explore the parameter space of the MSG landscape generator, producing instances with diverse graph topologies. Our experiments show that the proposed BoAs closely align with gradient-based BoAs, and that NS successfully generates instances with varied search difficulty and connectivity patterns among optima. Finally, over the instances generated by NS, we predict the success rate of two well-established evolutionary algorithms from LON features. While our LON construction is specific to MSG landscapes, the proposed framework provides a dataset that serves as a foundation for landscape-aware optimization.
- [6] arXiv:2605.00366 (replaced) [pdf, html, other]
-
Title: Geometric and dynamical analysis of attractor boundaries and storage limits in kernel Hopfield networksComments: 10 pages, 6 figuresSubjects: Neural and Evolutionary Computing (cs.NE); Machine Learning (cs.LG)
High-capacity associative memories based on Kernel Logistic Regression (KLR) exhibit strong storage capabilities, but the dynamical and geometric mechanisms underlying their stability remain poorly understood. This paper investigates the global geometry of attractor basins and the mechanisms governing the storage limit in KLR-trained Hopfield networks. We combine empirical evaluations using random sequences and real-world image embeddings (CIFAR-10) with morphing experiments and statistical Signal-to-Noise Ratio (SNR) analysis. Our experiments show that the network achieves a storage capacity for random sequences up to $P/N \approx 16,ドル while maintaining stable retrieval for structured data at effective loads near $P/N \approx 20$. Morphing analysis indicates that attractors on the "Ridge of Optimization" are separated by sharp, phase-transition-like boundaries, characterized by steep effective potential barriers and critical slowing down. Furthermore, by comparing an SNR analysis with a geometric reference point inspired by Cover's theorem, we show that the practical storage limit is governed primarily not by a lack of geometric separability in the feature space, but by the loss of dynamical stability against crosstalk noise. These findings suggest that KLR networks function as highly localized exemplar-based memories that operate near the onset of dynamical collapse, providing a useful perspective on the design of robust, large-scale retrieval systems.
- [7] arXiv:2606.30530 (replaced) [pdf, html, other]
-
Title: Computing the Integral R2 Indicator by Perspective Mapping and Box DecompositionComments: 1 Figure, 1 Table, 24 pages, Python implementation available on GithubSubjects: Computational Geometry (cs.CG); Neural and Evolutionary Computing (cs.NE); Numerical Analysis (math.NA); Optimization and Control (math.OC)
The continuous integral R2 indicator is a Pareto-compliant refinement of the classical finite-weight-vector R2 indicator, used in performance assessment, bounded archiving for a-posteriori multi-objective optimization, and skyline selection in databases. This work introduces a bidirectional perspective mapping between continuous integral R2 computation and integration over unions of anchored axis-aligned boxes. After translating the ideal point of a minimization problem to the origin, approximation points become strictly positive loss vectors, and the subgraph of the lower weighted Tchebycheff envelope over the weight simplex maps to the complement of an anchored-box union in reciprocal objective space. The Jacobian gives an absolute R2 formula as a weighted complement volume with density $(x_1+\cdots+x_N)^{-(N+1)},ドル while differences of R2 values become finite weighted hypervolume differences. Hence, hypervolume algorithms that emit box decompositions can be reused by replacing ordinary box volumes with closed-form weighted box integrals. For $N$ objectives, this gives an output-sensitive overhead $O(2^N M)$ for an $M$-box decomposition, or $O(M)$ for fixed $N$. Using existing box-decomposition approaches, the integral R2 can be computed in $O(n \log n)$ for $N=2,3,ドル in $O(n^2)$ for $N=4,ドル and in $O\left(n^{\lfloor (N-1)/2\rfloor+1}\right)$ for $N\geq4,ドル with $n$ denoting the size of the approximation set. On the lower-bound side, exact value computation has an $\Omega(n\log n)$ lower bound in the algebraic decision-tree model already in two objectives, this bound lifts to every fixed $N\geq2,ドル and exact computation is $\#P$-hard when $N$ is part of the input. Together, the proposed perspective mapping provides a powerful tool for transferring algorithmic and structural results between anchored-box union and hypervolume theory and integral R2 computation.