Evolving Kolmogorov-Arnold Networks

From ISLAB/CAISR
Title Evolving Kolmogorov-Arnold Networks
Summary This project aims to enhance the architecture of Kolmogorov-Arnold Networks (KANs) by optimizing key components such as loss functions, activation functions, initialization methods, and learning processes to improve their performance and interpretability.
Keywords
TimeFrame Fall 2024
References
Prerequisites
Author
Supervisor Mohammed Ghaith Altarabichi
Level Master
Status Open


Kolmogorov-Arnold Networks (KANs), recently proposed by researchers at MIT, present a promising alternative to traditional Multi-Layer Perceptrons (MLPs), demonstrating superior performance in terms of both accuracy and interpretability. The goal of this project is to further advance the architecture of KANs by enhancing their computational graph through various research directions. These include optimizing loss functions, refining activation functions, developing more effective initialization schemes, and improving learning processes.

https://arxiv.org/abs/2404.19756 https://arxiv.org/abs/2407.13044 https://arxiv.org/abs/2407.20667