mini-AGI is an experimental continual learning, byte-level language model that trains itself from scratch on a single 8GB VRAM GPU, paging its weights from disk as needed, and keeps learning from a stream of data without catastrophic forgetting. It assembles its own architecture using recurrent blocks, adaptive depth, and mixture-of-experts routing.
This resource is most valuable when experimenting with local model training, continual learning research, or learning about novel architectures like adaptive-depth recurrent blocks and disk-paged mixture-of-experts on modest hardware. It is not suited for production use, as it is explicitly a toy-level experiment.