TFenrir

TFenrir t1_iqso0px wrote

54

TFenrir t1_iqsmn2y wrote

I'm not an expert, it would be great to hear from one, I'm going to look around Twitter and see if any are talking about it. But it sounds really good from my reading.

5

TFenrir t1_iqscgqq wrote

Holy fucking shit.

> In this paper, we implement a LM-based code generation model with the ability to rewrite and improve its own source code, thereby achieving the first practical implementation of a self-programming AI system. With free-form source code modification, it is possible for our model to change its own model architecture, computational capacity, and learning dynamics. Since this system is designed for programming deep learning models, it is also capable of generating code for models other than itself. Such models can be seen as sub-models through which the main model indirectly performs auxiliary tasks. We explore this functionality in depth, showing that our model can easily be adapted to generate the source code of other neural networks to perform various computer vision tasks. We illustrate our system’s ability to fluidly program other deep learning models, which can be extended to support model development in various other fields of machine learning.

Okay... I am just starting this paper and it is making INCREDIBLE claims. I need to read the rest of this and I really wonder who the authors are...

114