Knowledge Base Index

This note was initially drafted with LLM assistance. Generated notes are periodically reviewed and revised by the author.

Notes by Topic

ALife 2020

ALife Conference

Agent

Algorithm

Algorithmic Information theory

Applied maths

Art

Artificial Intelligence

Artificial intelligence test

Artificial life

Attention

BART

  • mBART (3 links, 0 backlinks)
  • DQ-BART (4 links, 0 backlinks)

BERT

Biological life

CLIP

Capitalism

Carbon emissions

Cellular automata

Chaos

Chinchilla

Christopher Langton

Climate

Co-evolution

Coding

Coding agent

Combinatorics

Complex Systems

Complexity

Complexity metrics

Compression

Computability theory

Computer science

Computer vision

Consciousness

Convolutional neural networks

Cryptography

Data representation

Diffusion models

Distillation

Dynamical systems

Economic liberalism

Economics

Emacs

Emergence

Energy

Entropy

Entropy coding

Europe

Evaluating NLP

Evolution

Evolutionary algorithms

  • CMA-ES (1 links, 0 backlinks)

Evolutionary strategies

  • NEAT (3 links, 2 backlinks)

Few-shot learning

Finance

Finite state machines

GPT

Generative modelling

Genetic algorithms

  • CPPN (2 links, 3 backlinks)

Geospatial AI

Gradient descent

Graph neural networks

Graphs

Halting problem

Image processing

In-context learning

Ising model

John Von Neumann

Kernel Methods

LLM

Language

Language modeling

Life

Logic

Machine learning

Mathematics

Meta-learning

Model Context Protocol

Morphogenesis

Multi-agent collaboration

NLP

Natural language processing

Network authentication

Networking

  • NEAT (3 links, 2 backlinks)

Neural cellular automata

Neural network training

Neural networks

Noise

OPT: Open Pre-trained Transformer

Online privacy

Open-ended Evolution

Optimization

Org-mode

PaLM

Philosophy

Physics

Privacy

Probabilities

Program synthesis

Programming

Programming languages

Python

Quality diversity

Recurrent neural networks

Reinforcement learning

Retrieval augmented generation

RoBERTa

Robotics

Search algorithms

Self-organization

Self-supervised learning

Semantic similarity

Signal processing

Society

Statistical physics

Statistics

T5

Taxation

The Scaling Hypothesis

Theory of computation

Transfer learning

Transformer-XL

  • XLNet (4 links, 0 backlinks)

Transformers

Turing-completeness

Unconventional computing

Unsupervised learning

ViT

Vision transformer

Writing

Uncategorized

Paper Notes

Citation Key Title Tags Has Summary
schmidhuberComputerScientistView1999 A Computer Scientist’s View of Life, the Universe, and Ev… Zuse’s thesis yes
raimbaultModelUrbanEvolution2020 A model of urban evolution based on innovation diffusion … ALife 2020, Complex Systems, Evolution, Urban science yes
sayamaNewStructurallyDissolvable1999 A new structurally dissolvable self-reproducing loop evol… Cellular automata, Evolution yes
cluneAIGAsAIgeneratingAlgorithms2019 AI-GAs: AI-generating algorithms, an alternate paradigm f… Artificial Intelligence, Genetic algorithms, Open-ended Evolution yes
tutumAdaptingUnseenEnvironments2020 Adapting to Unseen Environments through Explicit Represen… Meta-learning, Reinforcement learning, ALife 2020 yes
beerIntegratedPerspectiveConstitutive2020 An Integrated Perspective on the Constitutive and Interac… Emergence, Life, Cellular automata yes
chenAttentionResiduals2026 Attention Residuals by Kimi Team, Guangyu Chen, Yu Zhang,… Transformers, LLM, Scaling laws, Attention, Residual neural networks yes
quCORALAutonomousMultiAgent2026 CORAL: Towards Autonomous Multi-Agent Evolution for Open-… Open-ended evolution, Co-evolution, Quality diversity yes
gilpinCellularAutomataConvolutional2018 Cellular automata as convolutional neural networks by Gil… Cellular automata as CNNs yes
benderClimbingNLUMeaning2020 Climbing towards NLU: On Meaning, Form, and Understanding… NLP, Artificial Intelligence, Evaluating NLP yes
kruszewskiCombinatoryChemistrySimple2020 Combinatory Chemistry: Towards a Simple Model of Emergent… Artificial life, Combinatory logic yes
mcsheaComplexityEvolutionWhat1991 Complexity and evolution: What everybody knows by McShea,… Evolution, Complexity yes
pathakCuriosityDrivenExplorationSelfSupervised2017 Curiosity-Driven Exploration by Self-Supervised Predictio… Reinforcement learning no
lehreDevelopmentalMappingsPhenotypic2003 Developmental mappings and phenotypic complexity by Lehre… Cellular automata yes
brantDiversityPreservationMinimal2020 Diversity preservation in minimal criterion coevolution t… Co-evolution, Evolutionary algorithms yes
huDrinkingFirehoseContinual2020 Drinking from a Firehose: Continual Learning with Web-sca… Continual learning no
phamEfficientNeuralArchitecture2018 Efficient Neural Architecture Search via Parameter Sharin… Neural architecture search yes
zhangEmbarrassinglySimpleSelfDistillation2026 Embarrassingly Simple Self-Distillation Improves Code Gen… Distillation, Language modeling, Program synthesis, Large language models yes
gershensonEmergenceArtificialLife2021 Emergence in artificial life by Gershenson, C. (2021) Artificial life, Emergence no
nehanivEvolutionAsynchronousCellular2003 Evolution in asynchronous cellular automata by Nehaniv, C… Cellular automata, Evolution yes
patteeEvolvedOpenEndednessNot2019 Evolved Open-Endedness, Not Open-Ended Evolution by Patte… yes
stanleyEvolvingNeuralNetworks2002 Evolving Neural Networks through Augmenting Topologies by… Neural networks, Genetic algorithms, NAS yes
millerEvolvingSelfrepairingSelfregulating2004 Evolving a self-repairing, self-regulating, French flag o… Cellular automata, Self-organization, Evolutionary strategies yes
flageatFastStableMAPElites2020 Fast and stable MAP-Elites in noisy domains using deep gr… ALife 2020, MAP-Elites, Quality diversity yes
adamsFormalDefinitionsUnbounded2017 Formal Definitions of Unbounded Evolution and Innovation … Open-ended Evolution, Cellular automata no
chngGARFGaussianActivated2022 GARF: Gaussian Activated Radiance Fields for High Fidelit… Implicit neural representations, NeRF no
leeGeckoVersatileText2024 Gecko: Versatile Text Embeddings Distilled from Large Lan… NLP, LLM, Semantic similarity yes
aachGeneralizationDifferentCellular2021 Generalization over different cellular automata rules lea… Cellular automata, Neural networks no
ainsworthGitReBasinMerging2022 Git Re-Basin: Merging Models modulo Permutation Symmetrie… Neural networks yes
mordvintsevGrowingNeuralCellular2020 Growing Neural Cellular Automata by Mordvintsev, A., Rand… Cellular automata yes
ramsauerHopfieldNetworksAll2020 Hopfield Networks is All You Need by Ramsauer, H., Schäfl… Hopfield Networks, Attention yes
voitaInformationTheoreticProbingMinimum2020 Information-Theoretic Probing with Minimum Description Le… Evaluating NLP, Transformers, Minimum description length yes
brooksIntelligenceRepresentation1991 Intelligence without representation by Brooks, R. A. (1991) Artificial Intelligence no
reinkeIntrinsicallyMotivatedDiscovery2020 Intrinsically Motivated Discovery of Diverse Patterns in … yes
yangLargeLanguageModels2023 Large Language Models as Optimizers by Yang, C., Wang, X…. Optimization, Machine learning, Natural language processing yes
tancikLearnedInitializationsOptimizing2021 Learned Initializations for Optimizing Coordinate-Based N… Neural radiance fields, Meta-learning no
zophLearningTransferableArchitectures2018 Learning Transferable Architectures for Scalable Image Re… NAS yes
voelkerLegendreMemoryUnits2019 Legendre Memory Units: Continuous-Time Representation in … Recurrent neural networks yes
wuMemorizingTransformers2022 Memorizing Transformers by Wu, Y., Rabe, M. N., Hutchins,… Transformers, Memory in neural networks yes
leeMetaHarnessEndtoEnd2026 Meta-Harness: End-to-End Optimization of Model Harnesses … Machine learning, Optimization, Meta-learning, Program synthesis yes
minimaxScalingTestTimeCompute2025 MiniMax-M1: Scaling Test-Time Compute Efficiently with Li… Foundation models, Reinforcement learning, Transformers, Scaling laws yes
wierstraModelingSystemsInternal2005 Modeling systems with internal state using evolino by Wie… Genetic algorithms, Recurrent neural networks yes
maziarkaMoleculeAttentionTransformer2020 Molecule Attention Transformer by Maziarka, Ł., Danel, T…. Neural networks yes
andersonMoreDifferent1972 More Is Different by Anderson, P. W. (1972) Complexity, Philosophy no
yeNetworkDeconvolution2020 Network Deconvolution by Ye, C., Evanusa, M., He, H., Mit… Convolutional neural networks, Neural network training yes
zophNeuralArchitectureSearch2017 Neural Architecture Search with Reinforcement Learning by… NAS yes
lechnerNeuralCircuitPolicies2020 Neural Circuit Policies Enabling Auditable Autonomy by Le… Neural networks no
floreanoNeuroevolutionArchitecturesLearning2008 Neuroevolution: from architectures to learning by Florean… NAS yes
gauthierNextGenerationReservoir2021 Next Generation Reservoir Computing by Gauthier, D. J., B… Reservoir computing no
xiongNystrOmformerNystr2021 Nyströmformer: A Nyström-Based Algorithm for Approximatin… Transformers yes
beckhamAdversarialMixupResynthesis2019 On Adversarial Mixup Resynthesis by Beckham, C., Honari, … Autoencoders yes
felleisenExpressivePowerProgramming1991 On the expressive power of programming languages by Felle… Programming languages no
yangOneModelLearning2022 One model for the learning of language by Yang, Y., & Pia… NLP, Artificial Intelligence, Machine learning no
khalifaPCGRLProceduralContent2020 PCGRL: Procedural Content Generation via Reinforcement Le… Reinforcement learning yes
wangPOETOpenendedCoevolution2019 POET: open-ended coevolution of environments and their op… Open-ended Evolution, Reinforcement learning yes
luPretrainedTransformersUniversal2021 Pretrained Transformers as Universal Computation Engines … Transformers no
horibeRegeneratingSoftRobots2021 Regenerating Soft Robots through Neural Cellular Automata… Cellular automata, Reinforcement learning yes
hubotterReinforcementLearningSelfDistillation2026 Reinforcement Learning via Self-Distillation by Hübotter,… Reinforcement learning, Distillation, Large language models, In-context learning yes
jensenReservoirComputingArtificial2020 Reservoir Computing in Artificial Spin Ice by Jensen, J. … Reservoir computing, Complex Systems yes
dongReservoirComputingMeets2020 Reservoir Computing meets Recurrent Kernels and Structure… Reservoir computing, Kernel Methods no
cikaResilientLifeExploration2020 Resilient Life: An Exploration of Perturbed Autopoietic P… ALife 2020, Cellular automata, Autopoiesis yes
grbicSafeReinforcementLearning2020 Safe Reinforcement Learning through Meta-learned Instinct… Meta-learning, Reinforcement learning, ALife 2020 yes
greydanusScalingDeepLearning2020 Scaling down Deep Learning by Greydanus, S. (2020) Neural networks no
sayamaSeekingOpenendedEvolution2011 Seeking open-ended evolution in Swarm Chemistry by Sayama… Open-ended Evolution yes
horowitzSpontaneousFinetuningEnvironment2017 Spontaneous fine-tuning to environment in many-species ch… Chemical reaction network, Biological life yes
simonArchitectureComplexity1962 The Architecture of Complexity by Simon, H. A. (1962) Complexity, Complex Systems no
aitkenGeometryIntegrationText2020 The geometry of integration in text classification RNNs b… RNN, NLP no
krakauerInformationTheoryIndividuality2020 The information theory of individuality by Krakauer, D., … Information theory, Life yes
weissThinkingTransformers2021 Thinking Like Transformers by Weiss, G., Goldberg, Y., & … NLP, Computer science no
leeTrainingLanguageModels2026 Training Language Models via Neural Cellular Automata by … Cellular automata, Neural cellular automata, Transfer learning, Kolmogorov complexity yes
katharopoulosTransformersAreRNNs2020 Transformers are RNNs: Fast Autoregressive Transformers w… Transformers, RNN yes
liTransitionPhenomenaCellular1990 Transition phenomena in cellular automata rule space by L… Cellular automata yes

Statistics

  • Total notes: 517
  • Concept notes: 445
  • Paper notes: 72
  • Orphan notes (no incoming links): 153
  • Broken links: 0
  • Average links per note: 2.9

Most Connected Notes

Last changed | authored by

Comments

Loading comments...

Leave a comment

Back to Notes