2 min readfrom Machine Learning

Hebbian architecture AI model [R]

Hebbian architecture AI model [R]
Hebbian architecture AI model [R]

Hello , for some time now i have been hooked on a side project after work hours, these are the results for a Hebbian architecture AI model. The model does not use backpropagation or gradients, the substrate started as a 1000k neuron and scaled to 100k between versions. The results bellow are results from 50epochs training with CIFAR 10 the results are bellow. Note that the substrat is not a fixed model the connections between neurons emerge "naturally" during training and the substrat settled using inly 5%-7% of the total parameter count. There are 2 distinct behaviors that were not designed but rather emerged from the architecture, 1: the model experiences slight dips on acc followed by jumps that exceeds the best previews score, after the full training the substart is intentionally damaged targeting the active neurons and pathways and than enter a session of recovery that almost achives baseline acc from epoch 1 , and than proceeds on surpassing the baseline acc. Every run has been made on a consumer GPU RTX 3060 12gb vram

submitted by /u/Antiqueity_Camp
[link] [comments]

Want to read more?

Check out the full article on the original site

View original article

Tagged with

#natural language processing for spreadsheets
#generative AI for data analysis
#rows.com
#Excel alternatives for data analysis
#real-time data collaboration
#financial modeling with spreadsheets
#real-time collaboration
#Hebbian architecture
#AI model
#neurons
#substrate
#backpropagation
#CIFAR 10
#training
#RTX 3060
#emerge
#consumer GPU
#parameters
#acc
#active neurons