biologically-inspired

Here are 5 public repositories matching this topic...

Mmorgan-ML / Neuromodulatory-Control-Networks

Neuromodulatory Control Networks (NCNs), a novel LLM architectural modification inspired by the neuromodulatory systems in the vertebrate brain.

python ai neuroscience pytorch attention feedforward-neural-network hypernetworks pytorch-implementation neuroscience-inspired-ai neuromodulated-networks neuromodulation biologically-inspired-algorithm large-language-models llm llms ai-architecture dynamic-processing context-dependent-processing biologically-inspired neuromodulatory-control-networks

Updated
Python

kuslavicek / pyresu

Star

A Python package implementing Rectified Spectral Units (ReSUs), a biologically inspired neural building block for backprop-free training using spectral decomposition and Canonical Correlation Analysis (CCA).

python machine-learning deep-learning neural-networks cca spectral-learning biologically-inspired

Updated
Python

lukehamond1001-alt / biogpt-dendritic

Star

BioGPT: A biologically-inspired dendritic language model with cortical columns, NMDA temporal memory, and pruning resilience that beats Pythia-160M

nlp deep-learning neuroscience pytorch transformer pruning language-model neural-architecture dendritic-computation biologically-inspired

Updated
Python

tomaszwi66 / dual-gate-neuron

Star

V6 Dual-Gate Neuron: biologically-inspired attention-free architecture for sequence modelling. Outperforms Transformer by 14.3% (unmatched params) and within 2% at matched capacity. PyTorch + arXiv paper.

deep-learning language-modeling pytorch transformer neural-networks sequence-modeling dendritic-computation neuroai biologically-inspired attention-free

Updated
Python

tomaszwi66 / bio-brain

Star

A real-time simulation of a virtual creature controlled by a spiking neural network built on biologically accurate mechanisms. The creature navigates a 2D world, forages for food, avoids predators and poisons, and learns from experience through dopamine-modulated synaptic plasticity.

neuroscience pytorch computational-neuroscience neuromorphic snn spiking-neural-network biologically-inspired brain-simulation

Updated
Python

Improve this page

Add a description, image, and links to the biologically-inspired topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the biologically-inspired topic, visit your repo's landing page and select "manage topics."

Learn more

URL: https://github.com/topics/biologically-inspired