Knowledge Base Index

This note was initially drafted with LLM assistance. Generated notes are periodically reviewed and revised by the author.

Notes by Topic

ALife 2020

ALife Conference

Agent

Algorithm

Algorithmic Information theory

Applied maths

Art

Artificial Intelligence

Artificial intelligence test

Artificial life

Attention

BART

  • mBART (3 links, 0 backlinks)
  • DQ-BART (4 links, 0 backlinks)

BERT

Biological life

CLIP

Capitalism

Carbon emissions

Catastrophic forgetting

Cellular automata

Chaos

Chinchilla

Christopher Langton

Climate

Co-evolution

Coding

Coding agent

Combinatorics

Complex Systems

Complexity

Complexity metrics

Compression

Computability theory

Computer science

Computer vision

Consciousness

Continual learning

Convolutional neural networks

Cryptography

Data representation

Diffusion models

Distillation

Dynamical systems

Economic liberalism

Economics

Emacs

Emergence

Energy

Entropy

Entropy coding

Europe

Evaluating NLP

Evolution

Evolutionary algorithms

  • CMA-ES (1 links, 0 backlinks)

Evolutionary strategies

  • NEAT (3 links, 2 backlinks)

Few-shot learning

Finance

Finite state machines

Foundation models

GPT

Generative modelling

Genetic algorithms

  • CPPN (2 links, 3 backlinks)

Geospatial AI

Gradient descent

Graph neural networks

Graphs

Grounding

Halting problem

Image processing

In-context learning

Ising model

John Von Neumann

Kernel Methods

LLM

Language

Language modeling

Large language models

Life

Logic

Machine learning

Mathematics

Meta-learning

Model Context Protocol

Morphogenesis

Multi-agent collaboration

NLP

Natural language processing

Network authentication

Networking

  • NEAT (3 links, 2 backlinks)

Neural cellular automata

Neural network training

Neural networks

Noise

OPT: Open Pre-trained Transformer

Object recognition

Online privacy

Open-ended Evolution

Optimization

Org-mode

PaLM

Philosophy

Physics

Privacy

Probabilities

Program synthesis

Programming

Programming languages

Python

Quality diversity

Recurrent neural networks

Reinforcement learning

Reinforcement learning with human feedback

Retrieval augmented generation

Reward shaping

RoBERTa

Robotics

Scaling laws

Search algorithms

Self-organization

Self-supervised learning

Self-training

Semantic similarity

Signal processing

Society

Spatial Reasoning

Statistical physics

Statistics

Supervised fine-tuning

T5

Taxation

Test-time compute

The Scaling Hypothesis

Theory of computation

Tool calling

Transfer learning

Transformer-XL

  • XLNet (4 links, 0 backlinks)

Transformers

Turing-completeness

Unconventional computing

Unsupervised learning

ViT

Vision Language Models

Vision transformer

Writing

Uncategorized

Paper Notes

Citation Key Title Tags Has Summary
schmidhuberComputerScientistView1999 A Computer Scientist’s View of Life, the Universe, and Ev… Zuse’s thesis yes
raimbaultModelUrbanEvolution2020 A model of urban evolution based on innovation diffusion … ALife 2020, Complex Systems, Evolution, Urban science yes
sayamaNewStructurallyDissolvable1999 A new structurally dissolvable self-reproducing loop evol… Cellular automata, Evolution yes
cluneAIGAsAIgeneratingAlgorithms2019 AI-GAs: AI-generating algorithms, an alternate paradigm f… Artificial Intelligence, Genetic algorithms, Open-ended Evolution yes
tutumAdaptingUnseenEnvironments2020 Adapting to Unseen Environments through Explicit Represen… Meta-learning, Reinforcement learning, ALife 2020 yes
beerIntegratedPerspectiveConstitutive2020 An Integrated Perspective on the Constitutive and Interac… Emergence, Life, Cellular automata yes
chenAttentionResiduals2026 Attention Residuals by Kimi Team, Guangyu Chen, Yu Zhang,… Transformers, LLM, Scaling laws, Attention, Residual neural networks yes
quCORALAutonomousMultiAgent2026 CORAL: Towards Autonomous Multi-Agent Evolution for Open-… Open-ended evolution, Co-evolution, Quality diversity yes
gilpinCellularAutomataConvolutional2018 Cellular automata as convolutional neural networks by Gil… Cellular automata as CNNs yes
benderClimbingNLUMeaning2020 Climbing towards NLU: On Meaning, Form, and Understanding… NLP, Artificial Intelligence, Evaluating NLP yes
kruszewskiCombinatoryChemistrySimple2020 Combinatory Chemistry: Towards a Simple Model of Emergent… Artificial life, Combinatory logic yes
mcsheaComplexityEvolutionWhat1991 Complexity and evolution: What everybody knows by McShea,… Evolution, Complexity yes
pathakCuriosityDrivenExplorationSelfSupervised2017 Curiosity-Driven Exploration by Self-Supervised Predictio… Reinforcement learning no
chenDFlashBlockDiffusion2026 DFlash: Block Diffusion for Flash Speculative Decoding by… LLM, Diffusion models, Transformers, Test-time compute yes
zhengDeepEyesIncentivizing2025 DeepEyes: Incentivizing “Thinking with Images” via Reinfo… Vision Language Models, Reinforcement learning, GRPO, Tool calling, Grounding, Reinforcement learning with verifiable rewards yes
lehreDevelopmentalMappingsPhenotypic2003 Developmental mappings and phenotypic complexity by Lehre… Cellular automata yes
brantDiversityPreservationMinimal2020 Diversity preservation in minimal criterion coevolution t… Co-evolution, Evolutionary algorithms yes
huDrinkingFirehoseContinual2020 Drinking from a Firehose: Continual Learning with Web-sca… Continual learning no
phamEfficientNeuralArchitecture2018 Efficient Neural Architecture Search via Parameter Sharin… Neural architecture search yes
zhangEmbarrassinglySimpleSelfDistillation2026 Embarrassingly Simple Self-Distillation Improves Code Gen… Distillation, Language modeling, Program synthesis, Large language models yes
gershensonEmergenceArtificialLife2021 Emergence in artificial life by Gershenson, C. (2021) Artificial life, Emergence no
carionEndToEndObject2020 End-to-End Object Detection with Transformers by Nicolas … Transformers, Attention, Computer vision, Object recognition, Positional encoding yes
nehanivEvolutionAsynchronousCellular2003 Evolution in asynchronous cellular automata by Nehaniv, C… Cellular automata, Evolution yes
patteeEvolvedOpenEndednessNot2019 Evolved Open-Endedness, Not Open-Ended Evolution by Patte… yes
stanleyEvolvingNeuralNetworks2002 Evolving Neural Networks through Augmenting Topologies by… Neural networks, Genetic algorithms, NAS yes
millerEvolvingSelfrepairingSelfregulating2004 Evolving a self-repairing, self-regulating, French flag o… Cellular automata, Self-organization, Evolutionary strategies yes
flageatFastStableMAPElites2020 Fast and stable MAP-Elites in noisy domains using deep gr… ALife 2020, MAP-Elites, Quality diversity yes
adamsFormalDefinitionsUnbounded2017 Formal Definitions of Unbounded Evolution and Innovation … Open-ended Evolution, Cellular automata no
chngGARFGaussianActivated2022 GARF: Gaussian Activated Radiance Fields for High Fidelit… Implicit neural representations, NeRF no
leeGeckoVersatileText2024 Gecko: Versatile Text Embeddings Distilled from Large Lan… NLP, LLM, Semantic similarity yes
aachGeneralizationDifferentCellular2021 Generalization over different cellular automata rules lea… Cellular automata, Neural networks no
wangGeoEyesOnDemand2026 GeoEyes: On-Demand Visual Focusing for Evidence-Grounded … Vision Language Models, Geospatial AI, Tool calling, GRPO, Reinforcement learning yes
ainsworthGitReBasinMerging2022 Git Re-Basin: Merging Models modulo Permutation Symmetrie… Neural networks yes
mordvintsevGrowingNeuralCellular2020 Growing Neural Cellular Automata by Mordvintsev, A., Rand… Cellular automata yes
ramsauerHopfieldNetworksAll2020 Hopfield Networks is All You Need by Ramsauer, H., Schäfl… Hopfield Networks, Attention yes
voitaInformationTheoreticProbingMinimum2020 Information-Theoretic Probing with Minimum Description Le… Evaluating NLP, Transformers, Minimum description length yes
brooksIntelligenceRepresentation1991 Intelligence without representation by Brooks, R. A. (1991) Artificial Intelligence no
reinkeIntrinsicallyMotivatedDiscovery2020 Intrinsically Motivated Discovery of Diverse Patterns in … yes
yangLargeLanguageModels2023 Large Language Models as Optimizers by Yang, C., Wang, X…. Optimization, Machine learning, Natural language processing yes
tancikLearnedInitializationsOptimizing2021 Learned Initializations for Optimizing Coordinate-Based N… Neural radiance fields, Meta-learning no
zophLearningTransferableArchitectures2018 Learning Transferable Architectures for Scalable Image Re… NAS yes
voelkerLegendreMemoryUnits2019 Legendre Memory Units: Continuous-Time Representation in … Recurrent neural networks yes
bidermanLoRALearns2024 LoRA Learns Less and Forgets Less by Dan Biderman, Jacob … LLM, Continual learning, Catastrophic forgetting, Transfer learning, Language modeling yes
wuMemorizingTransformers2022 Memorizing Transformers by Wu, Y., Rabe, M. N., Hutchins,… Transformers, Memory in neural networks yes
leeMetaHarnessEndtoEnd2026 Meta-Harness: End-to-End Optimization of Model Harnesses … Machine learning, Optimization, Meta-learning, Program synthesis yes
minimaxScalingTestTimeCompute2025 MiniMax-M1: Scaling Test-Time Compute Efficiently with Li… Foundation models, Reinforcement learning, Transformers, Scaling laws yes
wierstraModelingSystemsInternal2005 Modeling systems with internal state using evolino by Wie… Genetic algorithms, Recurrent neural networks yes
maziarkaMoleculeAttentionTransformer2020 Molecule Attention Transformer by Maziarka, Ł., Danel, T…. Neural networks yes
clarkMolmo2Video2026 Molmo2: Open Weights and Data for Vision-Language Models … Vision Language Models, Grounding, Synthetic training data yes
andersonMoreDifferent1972 More Is Different by Anderson, P. W. (1972) Complexity, Philosophy no
yeNetworkDeconvolution2020 Network Deconvolution by Ye, C., Evanusa, M., He, H., Mit… Convolutional neural networks, Neural network training yes
zophNeuralArchitectureSearch2017 Neural Architecture Search with Reinforcement Learning by… NAS yes
lechnerNeuralCircuitPolicies2020 Neural Circuit Policies Enabling Auditable Autonomy by Le… Neural networks no
floreanoNeuroevolutionArchitecturesLearning2008 Neuroevolution: from architectures to learning by Florean… NAS yes
gauthierNextGenerationReservoir2021 Next Generation Reservoir Computing by Gauthier, D. J., B… Reservoir computing no
xiongNystrOmformerNystr2021 Nyströmformer: A Nyström-Based Algorithm for Approximatin… Transformers yes
beckhamAdversarialMixupResynthesis2019 On Adversarial Mixup Resynthesis by Beckham, C., Honari, … Autoencoders yes
felleisenExpressivePowerProgramming1991 On the expressive power of programming languages by Felle… Programming languages no
yangOneModelLearning2022 One model for the learning of language by Yang, Y., & Pia… NLP, Artificial Intelligence, Machine learning no
khalifaPCGRLProceduralContent2020 PCGRL: Procedural Content Generation via Reinforcement Le… Reinforcement learning yes
wangPOETOpenendedCoevolution2019 POET: open-ended coevolution of environments and their op… Open-ended Evolution, Reinforcement learning yes
bolyaPerceptionEncoder2025 Perception Encoder: The best visual embeddings are not at… Vision Language Models, Computer vision, CLIP, Contrastive learning, Vision transformer, Foundation models yes
luPretrainedTransformersUniversal2021 Pretrained Transformers as Universal Computation Engines … Transformers no
horibeRegeneratingSoftRobots2021 Regenerating Soft Robots through Neural Cellular Automata… Cellular automata, Reinforcement learning yes
hubotterReinforcementLearningSelfDistillation2026 Reinforcement Learning via Self-Distillation by Hübotter,… Reinforcement learning, Distillation, Large language models, In-context learning yes
jensenReservoirComputingArtificial2020 Reservoir Computing in Artificial Spin Ice by Jensen, J. … Reservoir computing, Complex Systems yes
dongReservoirComputingMeets2020 Reservoir Computing meets Recurrent Kernels and Structure… Reservoir computing, Kernel Methods no
makResidualMatrixTransformers2025 Residual Matrix Transformers: Scaling the Size of the Res… Transformers, LLM, Scaling laws, Attention, Residual neural networks, Memory in neural networks yes
cikaResilientLifeExploration2020 Resilient Life: An Exploration of Perturbed Autopoietic P… ALife 2020, Cellular automata, Autopoiesis yes
carionSAMSegmentAnything2025 SAM 3: Segment Anything with Concepts by Nicolas Carion, … Computer vision, Foundation models, Object recognition, Vision Language Models, Grounding, Synthetic training data yes
grbicSafeReinforcementLearning2020 Safe Reinforcement Learning through Meta-learned Instinct… Meta-learning, Reinforcement learning, ALife 2020 yes
greydanusScalingDeepLearning2020 Scaling down Deep Learning by Greydanus, S. (2020) Neural networks no
sayamaSeekingOpenendedEvolution2011 Seeking open-ended evolution in Swarm Chemistry by Sayama… Open-ended Evolution yes
shenfeldSelfDistillationContinual2026 Self-Distillation Enables Continual Learning by Idan Shen… Continual learning, Catastrophic forgetting, Distillation, In-context learning, Large language models yes
horowitzSpontaneousFinetuningEnvironment2017 Spontaneous fine-tuning to environment in many-species ch… Chemical reaction network, Biological life yes
simonArchitectureComplexity1962 The Architecture of Complexity by Simon, H. A. (1962) Complexity, Complex Systems no
aitkenGeometryIntegrationText2020 The geometry of integration in text classification RNNs b… RNN, NLP no
krakauerInformationTheoryIndividuality2020 The information theory of individuality by Krakauer, D., … Information theory, Life yes
weissThinkingTransformers2021 Thinking Like Transformers by Weiss, G., Goldberg, Y., & … NLP, Computer science no
leeTrainingLanguageModels2026 Training Language Models via Neural Cellular Automata by … Cellular automata, Neural cellular automata, Transfer learning, Kolmogorov complexity yes
katharopoulosTransformersAreRNNs2020 Transformers are RNNs: Fast Autoregressive Transformers w… Transformers, RNN yes
liTransitionPhenomenaCellular1990 Transition phenomena in cellular automata rule space by L… Cellular automata yes
murLabadiaVJEPA2026 V-JEPA 2.1: Unlocking Dense Features in Video Self-Superv… Self-supervised learning, Vision transformer, Foundation models, Robotics yes

Statistics

  • Total notes: 549
  • Concept notes: 466
  • Paper notes: 83
  • Orphan notes (no incoming links): 147
  • Broken links: 0
  • Average links per note: 3.2

Most Connected Notes

Orphan Notes (no incoming links)

Last changed | authored by

Comments

Loading comments...

Leave a comment

Back to Notes