In this chapter, the Autonomous Learning Multi-Model (ALMMo) systems are introduced, which are based on the AnYa type neuro-fuzzy systems and can be seen as an universal self-developing, self-evolving, stable, locally optimal proven universal approximators. This chapter starts with the general concepts and principles of the zero- and first-order ALMMo systems, and, then, describes the architecture followed by the learning methods. The ALMMo system does not impose generation models with parameters on the empirically observed data, and has the advantages of being non-parametric, non-iterative and assumption-free, and, thus, it can objectively disclose the underlying data pattern. With a prototype-based nature, the ALMMo system is able to self-develop, self-learn and evolve autonomously. The theoretical proof (using Lyapunov theorem) of the stability of the first-order ALMMo systems is provided demonstrating that the first-order ALMMo systems are also stable. The theoretical proof of the local optimality which satisfies Karush-Kuhn-Tucker conditions is also given. © 2019, Springer Nature Switzerland AG.