Notes by Topic
ALife 2020
- Talk: Alife 2020 keynote Lee Cronin - A Top Down Chemically Embodied Artificial Life Computation (9 links, 1 backlinks)
- Talk: Alife 2020 keynote Michael Levin - Robot Cancer (4 links, 1 backlinks)
- Talk: Alife 2020 keynote Luis Zaman - New Frontiers in Alife: What was old is new again (14 links, 1 backlinks)
ALife Conference
- ALife 2020 (24 links, 9 backlinks)
Agent
- Coding agent (5 links, 4 backlinks)
- Geospatial AI (7 links, 3 backlinks)
- Tool calling (3 links, 2 backlinks)
- Model Context Protocol (5 links, 2 backlinks)
Algorithm
- Gradient descent (2 links, 10 backlinks)
- Search algorithms (1 links, 5 backlinks)
- Dijkstra’s algorithm (2 links, 2 backlinks)
- Backpropagation (2 links, 2 backlinks)
- Levenshtein distance (2 links, 1 backlinks)
- Generative art (2 links, 1 backlinks)
- Graham scan (1 links, 0 backlinks)
- Fast Marching method (3 links, 0 backlinks)
- Adaptive Computation Time (3 links, 0 backlinks)
- Stable marriage problem (1 links, 0 backlinks)
- Frank-Wolfe algorithm (2 links, 0 backlinks)
- Levenshtein automata (3 links, 0 backlinks)
- Knuth-Morris-Pratt string-searching algorithm (2 links, 0 backlinks)
- Pattern-defeating quicksort (1 links, 0 backlinks)
Algorithmic Information theory
- Kolmogorov complexity (4 links, 5 backlinks)
- Minimum description length (2 links, 1 backlinks)
- Halting probability (3 links, 0 backlinks)
- Algorithmic probability (2 links, 0 backlinks)
Applied maths
- Machine learning (6 links, 57 backlinks)
- Optimization (2 links, 15 backlinks)
- Dynamical systems (2 links, 12 backlinks)
- Cryptography (2 links, 12 backlinks)
- Statistics (1 links, 7 backlinks)
- Signal processing (1 links, 5 backlinks)
- Image processing (3 links, 4 backlinks)
- Noise (2 links, 3 backlinks)
- Ordinary least squares (2 links, 2 backlinks)
- Dijkstra’s algorithm (2 links, 2 backlinks)
- Attractor networks (4 links, 2 backlinks)
- Nyström method (1 links, 1 backlinks)
- Generalization in Machine learning (2 links, 1 backlinks)
- Kullback-leibler divergence (1 links, 1 backlinks)
- Optimal transport (1 links, 1 backlinks)
- SIR model (1 links, 1 backlinks)
- Fast Marching method (3 links, 0 backlinks)
- Softmax (3 links, 0 backlinks)
- Optimal control (1 links, 0 backlinks)
- Wavelets (3 links, 0 backlinks)
- System of linear equations (3 links, 0 backlinks)
- Diffusion limited aggregation (2 links, 0 backlinks)
- Automatic differentiation (2 links, 0 backlinks)
Art
- Generative art (2 links, 1 backlinks)
- Art with Cellular Automata (4 links, 0 backlinks)
- Creative coding (2 links, 0 backlinks)
Artificial Intelligence
- Machine learning (6 links, 57 backlinks)
- Cellular automata (18 links, 51 backlinks)
- Open-ended Evolution (11 links, 19 backlinks)
- Artificial intelligence test (2 links, 7 backlinks)
- Alan Turing (3 links, 2 backlinks)
- Robotics (2 links, 2 backlinks)
- Article: Open-endedness: The last grand challenge you’ve never heard of (3 links, 1 backlinks)
- The Scaling Hypothesis (2 links, 1 backlinks)
- Neuroscience (2 links, 1 backlinks)
- The Bitter Lesson (4 links, 0 backlinks)
- AI and climate change (3 links, 0 backlinks)
- Motion planning (1 links, 0 backlinks)
- Why programming is a good medium for expressing poorly understood and sloppily-formulated ideas (5 links, 0 backlinks)
- Talk: The Importance of Open-Endedness in AI and Machine Learning (13 links, 0 backlinks)
- AI capitalism (2 links, 0 backlinks)
- Automation (2 links, 0 backlinks)
Artificial intelligence test
- Abstraction and Reasoning Corpus (1 links, 1 backlinks)
- Chinese room experiment (1 links, 1 backlinks)
- Turing test (3 links, 1 backlinks)
- Raven’s progressive matrices (3 links, 0 backlinks)
- Bongard problems (1 links, 0 backlinks)
Artificial life
- Evolution (2 links, 27 backlinks)
- ALife 2020 (24 links, 9 backlinks)
- Christopher Langton (6 links, 2 backlinks)
- Robotics (2 links, 2 backlinks)
- Tierra (2 links, 2 backlinks)
- Avida (4 links, 1 backlinks)
- ALife Conference (5 links, 1 backlinks)
- Talk: Alife 2020 keynote Luis Zaman - New Frontiers in Alife: What was old is new again (14 links, 1 backlinks)
- Emergence in artificial life (2 links, 0 backlinks)
Attention
- Positional encoding (2 links, 1 backlinks)
- Attention graph networks (2 links, 1 backlinks)
BART
BERT
- Vision transformer (3 links, 5 backlinks)
- Megatron (4 links, 1 backlinks)
- DistillBERT (4 links, 1 backlinks)
- RoBERTa (3 links, 1 backlinks)
- ALBERT (3 links, 0 backlinks)
- ERNIE (3 links, 0 backlinks)
Biological life
- Morphogenesis (2 links, 1 backlinks)
- RNA-world (1 links, 1 backlinks)
- Neuroscience (2 links, 1 backlinks)
- Ontogeny recapitulates phylogeny (2 links, 1 backlinks)
- Talk: Alife 2020 keynote Michael Levin - Robot Cancer (4 links, 1 backlinks)
- Article: Why Sex? Biologists Find New Explanations (2 links, 0 backlinks)
- Article: The End of the RNA World Is Near, Biochemists Argue (3 links, 0 backlinks)
CLIP
Capitalism
- AI capitalism (2 links, 0 backlinks)
Carbon emissions
- Carbon capture (2 links, 0 backlinks)
- Carbon offsetting (2 links, 0 backlinks)
Cellular automata
- Cellular automata as convolutional neural networks (8 links, 7 backlinks)
- Conway’s Game of Life (3 links, 5 backlinks)
- Elementary cellular automata (3 links, 4 backlinks)
- Langton’s loop (2 links, 3 backlinks)
- Turing completeness of cellular automata (4 links, 2 backlinks)
- Von Neumann’s self-reproducing CA (2 links, 2 backlinks)
- Lenia (2 links, 1 backlinks)
- Cellular automata as regular languages (2 links, 1 backlinks)
- Reversible cellular automata (1 links, 1 backlinks)
- Cellular neural networks (2 links, 0 backlinks)
- Abelian sandpile model (1 links, 0 backlinks)
- Complexity of cellular automata (3 links, 0 backlinks)
- Neural cellular automata and implicit representations (2 links, 0 backlinks)
- Cellular automata as recurrent neural networks (3 links, 0 backlinks)
- Crosshatch automata (1 links, 0 backlinks)
- Graph cellular automata (5 links, 0 backlinks)
- Computing in cellular automata (7 links, 0 backlinks)
Chaos
- Cellular automata (18 links, 51 backlinks)
Chinchilla
Christopher Langton
- Langton’s loop (2 links, 3 backlinks)
Climate
- Carbon emissions (1 links, 3 backlinks)
- Energy (1 links, 2 backlinks)
- Carbon tax (4 links, 1 backlinks)
- Greenhouse gas emissions (1 links, 0 backlinks)
- AI and climate change (3 links, 0 backlinks)
- Carbon capture (2 links, 0 backlinks)
- Kaya identity (1 links, 0 backlinks)
- Kuznets curve (2 links, 0 backlinks)
- Jevons paradox (4 links, 0 backlinks)
- Batteries (2 links, 0 backlinks)
- Carbon offsetting (2 links, 0 backlinks)
- Extractivism (3 links, 0 backlinks)
Co-evolution
- Multi-agent collaboration (3 links, 3 backlinks)
Coding
- Algorithm (2 links, 20 backlinks)
- Python (2 links, 6 backlinks)
- Program synthesis (4 links, 5 backlinks)
- Rust (3 links, 3 backlinks)
- Emacs (3 links, 3 backlinks)
- Haskell (2 links, 2 backlinks)
- C++ (2 links, 2 backlinks)
- Scala (2 links, 1 backlinks)
- Ruby (2 links, 1 backlinks)
- Javascript (2 links, 1 backlinks)
- Java (2 links, 1 backlinks)
- Functional programming (5 links, 1 backlinks)
- Regular expressions (2 links, 1 backlinks)
- Einops (1 links, 0 backlinks)
- Make (1 links, 0 backlinks)
- Sed utility (2 links, 0 backlinks)
- Why programming is a good medium for expressing poorly understood and sloppily-formulated ideas (5 links, 0 backlinks)
- Nix (2 links, 0 backlinks)
- Creative coding (2 links, 0 backlinks)
- Hilbert curve indexing (1 links, 0 backlinks)
Coding agent
- Multi-agent collaboration (3 links, 3 backlinks)
- Model Context Protocol (5 links, 2 backlinks)
Combinatorics
- Talk: Differentiation of black-box combinatorial solvers (2 links, 0 backlinks)
Complex Systems
- Climate (3 links, 13 backlinks)
- Santa Fe Institute (2 links, 3 backlinks)
- Ising model (3 links, 3 backlinks)
- Christopher Langton (6 links, 2 backlinks)
- Boolean networks (2 links, 2 backlinks)
- NK model (1 links, 1 backlinks)
- Chemical reaction network (1 links, 1 backlinks)
- Globalization (3 links, 1 backlinks)
- Article: Uncertain times (5 links, 0 backlinks)
- L-Systems (1 links, 0 backlinks)
- Automated discovery in complex systems (3 links, 0 backlinks)
- Article: The Cartoon Picture of Magnets That Has Transformed Science (5 links, 0 backlinks)
Complexity
- Open-ended Evolution (11 links, 19 backlinks)
- Emergence (2 links, 16 backlinks)
- Complexity metrics (9 links, 9 backlinks)
- Kolmogorov complexity (4 links, 5 backlinks)
- Lempel-Ziv-Welch algorithm (2 links, 1 backlinks)
- Minimum description length (2 links, 1 backlinks)
- Complexity of cellular automata (3 links, 0 backlinks)
- Algorithmic probability (2 links, 0 backlinks)
Complexity metrics
- Entropy (2 links, 6 backlinks)
- Assembly theory (2 links, 2 backlinks)
- Logical depth (3 links, 2 backlinks)
- Effective measure complexity (1 links, 1 backlinks)
- Statistical complexity (4 links, 1 backlinks)
Compression
- Entropy coding (2 links, 2 backlinks)
- Lempel-Ziv-Welch algorithm (2 links, 1 backlinks)
- Graph compression (2 links, 0 backlinks)
- Huffman coding (2 links, 0 backlinks)
- Arithmetic coding (2 links, 0 backlinks)
Computability theory
- Turing-completeness (9 links, 6 backlinks)
- Kolmogorov complexity (4 links, 5 backlinks)
- Turing Machine (3 links, 4 backlinks)
- Halting problem (1 links, 3 backlinks)
- Church-Turing thesis (3 links, 0 backlinks)
- Halting probability (3 links, 0 backlinks)
- Turing degree (2 links, 0 backlinks)
Computer science
- Coding (3 links, 23 backlinks)
- Algorithm (2 links, 20 backlinks)
- Programming languages (11 links, 18 backlinks)
- Cryptography (2 links, 12 backlinks)
- Turing-completeness (9 links, 6 backlinks)
- Program synthesis (4 links, 5 backlinks)
- Graphs (2 links, 4 backlinks)
- Turing Machine (3 links, 4 backlinks)
- Alan Turing (3 links, 2 backlinks)
- Compilation (5 links, 2 backlinks)
- Theory of computation (1 links, 1 backlinks)
- Lambda calculus (1 links, 1 backlinks)
- Functional programming (5 links, 1 backlinks)
- Wirth’s law (1 links, 1 backlinks)
- Locality-Sensitive Hashing (1 links, 0 backlinks)
- Illegal numbers (4 links, 0 backlinks)
- Quantization (6 links, 0 backlinks)
- Knuth-Morris-Pratt string-searching algorithm (2 links, 0 backlinks)
- Hash functions (3 links, 0 backlinks)
Computer vision
- Vision transformer (3 links, 5 backlinks)
- Image classification (5 links, 5 backlinks)
- Residual neural networks (3 links, 4 backlinks)
- CLIP (5 links, 3 backlinks)
- Geospatial AI (7 links, 3 backlinks)
- Object recognition (1 links, 1 backlinks)
- GLIDE (3 links, 1 backlinks)
- Imagen (7 links, 0 backlinks)
- Global context ViT (4 links, 0 backlinks)
- Flamingo (5 links, 0 backlinks)
- Swin Transformer (4 links, 0 backlinks)
- Style transfer (2 links, 0 backlinks)
Consciousness
- Schmidhuber on Consciousness (3 links, 0 backlinks)
- The Meta-Problem of Consciousness with David Chalmers (1 links, 0 backlinks)
Convolutional neural networks
- Cellular automata as convolutional neural networks (8 links, 7 backlinks)
- Residual neural networks (3 links, 4 backlinks)
- Graph convolutional networks (2 links, 2 backlinks)
Cryptography
- Public key encryption (1 links, 2 backlinks)
- Alan Turing (3 links, 2 backlinks)
- Symmetric encryption (1 links, 2 backlinks)
- Kerberos (5 links, 1 backlinks)
- Monero (1 links, 1 backlinks)
- Illegal numbers (4 links, 0 backlinks)
- Rainbow tables (1 links, 0 backlinks)
- Ssh (1 links, 0 backlinks)
- Ring signatures (3 links, 0 backlinks)
- Homomorphic encryption (3 links, 0 backlinks)
Data representation
- Autoencoders (2 links, 5 backlinks)
- Implicit neural representations (7 links, 3 backlinks)
- PCA (1 links, 1 backlinks)
Diffusion models
Distillation
- Self-training (6 links, 3 backlinks)
Dynamical systems
- Attractor (2 links, 1 backlinks)
- Learning in dynamical systems (2 links, 1 backlinks)
- Poincaré recurrence time (2 links, 1 backlinks)
- Neural networks as dynamical systems (7 links, 0 backlinks)
Economic liberalism
- Carbon tax (4 links, 1 backlinks)
- Globalization (3 links, 1 backlinks)
- Neoliberalism (2 links, 0 backlinks)
- Gig economy (2 links, 0 backlinks)
- Universal basic income (2 links, 0 backlinks)
Economics
- Economic liberalism (2 links, 5 backlinks)
- Taxation (1 links, 2 backlinks)
- Decentralization (1 links, 1 backlinks)
- Dutch disease (1 links, 1 backlinks)
- Capitalism (1 links, 1 backlinks)
- Finance (1 links, 1 backlinks)
- Globalization (3 links, 1 backlinks)
- Asset economy (1 links, 0 backlinks)
- Neoliberalism (2 links, 0 backlinks)
- Land-value tax (2 links, 0 backlinks)
- Gig economy (2 links, 0 backlinks)
- Resource curse (4 links, 0 backlinks)
- Snake in the tunnel (2 links, 0 backlinks)
- Universal basic income (2 links, 0 backlinks)
- Kuznets curve (2 links, 0 backlinks)
- Giffen goods (1 links, 0 backlinks)
- Jevons paradox (4 links, 0 backlinks)
- Futures contracts (2 links, 0 backlinks)
- Extractivism (3 links, 0 backlinks)
- Automation (2 links, 0 backlinks)
Emacs
Emergence
- Cellular automata (18 links, 51 backlinks)
- Talk: Alife 2020 keynote Michael Levin - Robot Cancer (4 links, 1 backlinks)
- Emergence in artificial life (2 links, 0 backlinks)
Energy
- Batteries (2 links, 0 backlinks)
Entropy
- Entropy coding (2 links, 2 backlinks)
Entropy coding
- Huffman coding (2 links, 0 backlinks)
- Arithmetic coding (2 links, 0 backlinks)
Europe
- Snake in the tunnel (2 links, 0 backlinks)
Evaluating NLP
- Semantic similarity (5 links, 3 backlinks)
- Spatial Reasoning (4 links, 0 backlinks)
Evolution
- Open-ended Evolution (11 links, 19 backlinks)
- Co-evolution (1 links, 5 backlinks)
- Quality diversity (4 links, 4 backlinks)
- Tierra (2 links, 2 backlinks)
- Avida (4 links, 1 backlinks)
- Ontogeny recapitulates phylogeny (2 links, 1 backlinks)
- Article: Why Sex? Biologists Find New Explanations (2 links, 0 backlinks)
Evolutionary algorithms
- CMA-ES (1 links, 0 backlinks)
Evolutionary strategies
- NEAT (3 links, 2 backlinks)
Few-shot learning
- Zero-shot learning (4 links, 1 backlinks)
Finance
- Futures contracts (2 links, 0 backlinks)
Finite state machines
- Cellular automata as regular languages (2 links, 1 backlinks)
- Levenshtein automata (3 links, 0 backlinks)
GPT
- GPT-3 (5 links, 8 backlinks)
- GPT-2 (2 links, 6 backlinks)
- Chinchilla (4 links, 2 backlinks)
- GPTInstruct (5 links, 1 backlinks)
- Gopher (5 links, 1 backlinks)
- Decision transformer (3 links, 1 backlinks)
- BlenderBot 3 (4 links, 1 backlinks)
- DALL-E (4 links, 1 backlinks)
- Megatron (4 links, 1 backlinks)
- OPT: Open Pre-trained Transformer (5 links, 1 backlinks)
- DialoGPT (4 links, 0 backlinks)
- Turing-NLG (5 links, 0 backlinks)
- BLOOM (5 links, 0 backlinks)
- SeeKer (2 links, 0 backlinks)
- Jurassic-1 (4 links, 0 backlinks)
- Sparrow (4 links, 0 backlinks)
- GPT-Neo (5 links, 0 backlinks)
- Trajectory transformer (4 links, 0 backlinks)
- ChatGPT (7 links, 0 backlinks)
Generative modelling
- Generative adversarial networks (5 links, 3 backlinks)
- Diffusion models (1 links, 3 backlinks)
Genetic algorithms
- CPPN (2 links, 3 backlinks)
Geospatial AI
- Spatial Reasoning (4 links, 0 backlinks)
Gradient descent
- Gradient flow (2 links, 2 backlinks)
Graph neural networks
- Graph convolutional networks (2 links, 2 backlinks)
- Message-passing graph networks (1 links, 2 backlinks)
- Attention graph networks (2 links, 1 backlinks)
Graphs
- Graph neural networks (5 links, 5 backlinks)
- Graph compression (2 links, 0 backlinks)
- Graph cellular automata (5 links, 0 backlinks)
Halting problem
- Halting probability (3 links, 0 backlinks)
Image processing
- Computer vision (3 links, 16 backlinks)
- Edge detection (1 links, 0 backlinks)
In-context learning
- Spatial Reasoning (4 links, 0 backlinks)
Ising model
- Article: The Cartoon Picture of Magnets That Has Transformed Science (5 links, 0 backlinks)
John Von Neumann
- Von Neumann’s self-reproducing CA (2 links, 2 backlinks)
Kernel Methods
- Kernel Machine (1 links, 0 backlinks)
LLM
- Agent (4 links, 4 backlinks)
- Retrieval augmented generation (3 links, 4 backlinks)
- Multi-agent collaboration (3 links, 3 backlinks)
- Geospatial AI (7 links, 3 backlinks)
- Self-training (6 links, 3 backlinks)
- In-context learning (4 links, 3 backlinks)
- Tool calling (3 links, 2 backlinks)
- Scaling laws (4 links, 2 backlinks)
- Vision Language Models (5 links, 1 backlinks)
- Synthetic training data (5 links, 1 backlinks)
- Reinforcement learning with verifiable rewards (4 links, 0 backlinks)
- Spatial Reasoning (4 links, 0 backlinks)
Language
- NLP (6 links, 58 backlinks)
- Semantic primes (1 links, 0 backlinks)
- Unker non-linear writing system (3 links, 0 backlinks)
Language modeling
- LLM (4 links, 20 backlinks)
- Self-training (6 links, 3 backlinks)
- LLM Harness (2 links, 2 backlinks)
Life
- Evolution (2 links, 27 backlinks)
- Talk: Alife 2020 keynote Lee Cronin - A Top Down Chemically Embodied Artificial Life Computation (9 links, 1 backlinks)
- Autopoiesis (1 links, 1 backlinks)
- Talk: Alife 2020 keynote Sara Walker - The Natural History of Information (1 links, 1 backlinks)
- Article: What Is an Individual? Biology Seeks Clues in Information Theory. (5 links, 0 backlinks)
Logic
- Gödel’s theorem (2 links, 2 backlinks)
- Combinatory logic (3 links, 2 backlinks)
- 3-SAT (1 links, 1 backlinks)
Machine learning
- NLP (6 links, 58 backlinks)
- Neural networks (4 links, 58 backlinks)
- Reinforcement learning (4 links, 24 backlinks)
- Recurrent neural networks (2 links, 23 backlinks)
- LLM (4 links, 20 backlinks)
- Computer vision (3 links, 16 backlinks)
- Transfer learning (1 links, 8 backlinks)
- Meta-learning (4 links, 7 backlinks)
- Neural network training (9 links, 6 backlinks)
- Distillation (3 links, 6 backlinks)
- Reservoir computing (8 links, 6 backlinks)
- Supervised learning (3 links, 5 backlinks)
- Foundation models (7 links, 4 backlinks)
- Few-shot learning (4 links, 4 backlinks)
- Self-supervised learning (8 links, 4 backlinks)
- Retrieval augmented generation (3 links, 4 backlinks)
- Coding agent (5 links, 4 backlinks)
- Data representation (3 links, 3 backlinks)
- Kernel Methods (1 links, 3 backlinks)
- Geospatial AI (7 links, 3 backlinks)
- Self-training (6 links, 3 backlinks)
- In-context learning (4 links, 3 backlinks)
- Unsupervised learning (1 links, 3 backlinks)
- Continual learning (4 links, 2 backlinks)
- Generative modelling (1 links, 2 backlinks)
- Scaling laws (4 links, 2 backlinks)
- LLM Harness (2 links, 2 backlinks)
- Algorithmic bias (1 links, 1 backlinks)
- Generalization in Machine learning (2 links, 1 backlinks)
- Federated learning (1 links, 1 backlinks)
- Bias-variance tradeoff (2 links, 1 backlinks)
- Adversarial examples (5 links, 1 backlinks)
- Alternative learning mechanisms (2 links, 1 backlinks)
- Privacy-preserving machine learning (2 links, 1 backlinks)
- Learning in dynamical systems (2 links, 1 backlinks)
- Text embeddings (5 links, 1 backlinks)
- Synthetic training data (5 links, 1 backlinks)
- Zero-shot learning (4 links, 1 backlinks)
- Pytorch (2 links, 1 backlinks)
- Catastrophic forgetting (3 links, 0 backlinks)
- The Bitter Lesson (4 links, 0 backlinks)
- AI and climate change (3 links, 0 backlinks)
- Gaussian Processes (1 links, 0 backlinks)
- Rademacher complexity (1 links, 0 backlinks)
- Reinforcement learning with verifiable rewards (4 links, 0 backlinks)
- t-SNE (1 links, 0 backlinks)
- Talk: Differentiation of black-box combinatorial solvers (2 links, 0 backlinks)
Mathematics
- Applied maths (1 links, 23 backlinks)
- Optimization (2 links, 15 backlinks)
- Graphs (2 links, 4 backlinks)
- Combinatorics (1 links, 1 backlinks)
- John Conway (1 links, 1 backlinks)
- Moore-Penrose inverse (1 links, 1 backlinks)
- Probabilities (1 links, 1 backlinks)
- Differential equations (1 links, 1 backlinks)
- Automated theorem proving (2 links, 1 backlinks)
- Hyperbolic geometry (1 links, 1 backlinks)
- Fourier transform (2 links, 0 backlinks)
- Tropical semiring (3 links, 0 backlinks)
- Fractional calculus (1 links, 0 backlinks)
- Matrix factorization (1 links, 0 backlinks)
- Minerva (3 links, 0 backlinks)
Meta-learning
- In-context learning (4 links, 3 backlinks)
Model Context Protocol
- Tool calling (3 links, 2 backlinks)
Morphogenesis
- Reaction-diffusion (2 links, 1 backlinks)
Multi-agent collaboration
- Model Context Protocol (5 links, 2 backlinks)
NLP
- GPT (4 links, 22 backlinks)
- LLM (4 links, 20 backlinks)
- Language modeling (7 links, 17 backlinks)
- BERT (2 links, 12 backlinks)
- GPT-3 (5 links, 8 backlinks)
- Reinforcement learning with human feedback (2 links, 4 backlinks)
- Word vectors (5 links, 4 backlinks)
- T5 (3 links, 3 backlinks)
- CLIP (5 links, 3 backlinks)
- Semantic similarity (5 links, 3 backlinks)
- Text classification (1 links, 3 backlinks)
- Chinchilla (4 links, 2 backlinks)
- PaLM (2 links, 2 backlinks)
- Transformer-XL (2 links, 2 backlinks)
- Switch transformer (3 links, 2 backlinks)
- GPTInstruct (5 links, 1 backlinks)
- Machine translation (1 links, 1 backlinks)
- BlenderBot 3 (4 links, 1 backlinks)
- Contrastive learning (4 links, 1 backlinks)
- GLaM (2 links, 1 backlinks)
- Byte-pair encoding (3 links, 1 backlinks)
- OPT: Open Pre-trained Transformer (5 links, 1 backlinks)
- Regular expressions (2 links, 1 backlinks)
- Text embeddings (5 links, 1 backlinks)
- DistillBERT (4 links, 1 backlinks)
- RoBERTa (3 links, 1 backlinks)
- GLIDE (3 links, 1 backlinks)
- LAMDA (2 links, 0 backlinks)
- ALBERT (3 links, 0 backlinks)
- Wu Dao 2.0 (3 links, 0 backlinks)
- CTRL (2 links, 0 backlinks)
- DialoGPT (4 links, 0 backlinks)
- Imagen (7 links, 0 backlinks)
- ELECTRA (2 links, 0 backlinks)
- Big bird (4 links, 0 backlinks)
- Flamingo (5 links, 0 backlinks)
- mBART (3 links, 0 backlinks)
- ERNIE (3 links, 0 backlinks)
- Turing-NLG (5 links, 0 backlinks)
- BLOOM (5 links, 0 backlinks)
- DQ-BART (4 links, 0 backlinks)
- Jurassic-1 (4 links, 0 backlinks)
- Pegasus (2 links, 0 backlinks)
- XLNet (4 links, 0 backlinks)
- GPT-Neo (5 links, 0 backlinks)
- ChatGPT (7 links, 0 backlinks)
- XLM-RoBERTa (3 links, 0 backlinks)
Natural language processing
- Evaluating NLP (3 links, 5 backlinks)
- Levenshtein distance (2 links, 1 backlinks)
Network authentication
- Kerberos (5 links, 1 backlinks)
Networking
- Network programming (2 links, 0 backlinks)
Neural architecture search
- NEAT (3 links, 2 backlinks)
Neural cellular automata
- Neural cellular automata and implicit representations (2 links, 0 backlinks)
Neural network training
- Double descent (3 links, 1 backlinks)
- The Lottery ticket hypothesis (3 links, 1 backlinks)
- Synthetic training data (5 links, 1 backlinks)
Neural networks
- Transformers (8 links, 66 backlinks)
- Recurrent neural networks (2 links, 23 backlinks)
- Attention (1 links, 16 backlinks)
- Convolutional neural networks (1 links, 10 backlinks)
- Neural architecture search (7 links, 7 backlinks)
- Neural network training (9 links, 6 backlinks)
- Distillation (3 links, 6 backlinks)
- Graph neural networks (5 links, 5 backlinks)
- Autoencoders (2 links, 5 backlinks)
- Residual neural networks (3 links, 4 backlinks)
- Implicit neural representations (7 links, 3 backlinks)
- Generative adversarial networks (5 links, 3 backlinks)
- CPPN (2 links, 3 backlinks)
- Hopfield Networks (5 links, 2 backlinks)
- Backpropagation (2 links, 2 backlinks)
- Variational autoencoders (3 links, 2 backlinks)
- LayerNorm (3 links, 2 backlinks)
- Attractor networks (4 links, 2 backlinks)
- Batch normalization (1 links, 2 backlinks)
- NEAT (3 links, 2 backlinks)
- Neural network pruning (1 links, 1 backlinks)
- Memory in neural networks (1 links, 1 backlinks)
- The Scaling Hypothesis (2 links, 1 backlinks)
- Adversarial examples (5 links, 1 backlinks)
- Double descent (3 links, 1 backlinks)
- Adaptive Computation Time (3 links, 0 backlinks)
- Cellular neural networks (2 links, 0 backlinks)
- Gradient descent for wide two-layer neural networks – I : Global convergence (4 links, 0 backlinks)
- Neural networks as dynamical systems (7 links, 0 backlinks)
- Quantization (6 links, 0 backlinks)
- Mean field theory of neural networks (talk) (2 links, 0 backlinks)
- Neural tangent kernel (3 links, 0 backlinks)
Noise
- Blue noise (1 links, 0 backlinks)
OPT: Open Pre-trained Transformer
- BlenderBot 3 (4 links, 1 backlinks)
Online privacy
- Privacy-preserving machine learning (2 links, 1 backlinks)
Open-ended Evolution
- Article: Open-endedness: The last grand challenge you’ve never heard of (3 links, 1 backlinks)
- Picbreeder (2 links, 1 backlinks)
- Talk: The Importance of Open-Endedness in AI and Machine Learning (13 links, 0 backlinks)
Optimization
- Gradient descent (2 links, 10 backlinks)
- Neural network training (9 links, 6 backlinks)
- Ordinary least squares (2 links, 2 backlinks)
- Gradient flow (2 links, 2 backlinks)
- Gradient descent for wide two-layer neural networks – I : Global convergence (4 links, 0 backlinks)
- Frank-Wolfe algorithm (2 links, 0 backlinks)
- Projection on convex sets (1 links, 0 backlinks)
- Linear programming (1 links, 0 backlinks)
- Automatic differentiation (2 links, 0 backlinks)
Org-mode
- Org-roam (5 links, 1 backlinks)
PaLM
- Minerva (3 links, 0 backlinks)
Philosophy
- Zuse’s thesis (5 links, 5 backlinks)
- Consciousness (1 links, 2 backlinks)
- The Simulated reality hypothesis (4 links, 1 backlinks)
- Reductionism (5 links, 1 backlinks)
- Nick Bostrom (1 links, 1 backlinks)
- Knowledge argument (1 links, 0 backlinks)
Physics
- Complex Systems (10 links, 24 backlinks)
- Emergence (2 links, 16 backlinks)
- Dynamical systems (2 links, 12 backlinks)
- Zuse’s thesis (5 links, 5 backlinks)
- Santa Fe Institute (2 links, 3 backlinks)
- Ising model (3 links, 3 backlinks)
- Attractor networks (4 links, 2 backlinks)
- Chaos (2 links, 2 backlinks)
- Morphogenesis (2 links, 1 backlinks)
- Reductionism (5 links, 1 backlinks)
- Attractor (2 links, 1 backlinks)
- Statistical physics (2 links, 1 backlinks)
- Reaction-diffusion (2 links, 1 backlinks)
- Boltzmann brain (4 links, 0 backlinks)
- Diffusion limited aggregation (2 links, 0 backlinks)
Privacy
- Online privacy (1 links, 3 backlinks)
- Surveillance (2 links, 0 backlinks)
Probabilities
- Dirichlet distribution (1 links, 1 backlinks)
Program synthesis
- Coding agent (5 links, 4 backlinks)
Programming
- Networking (1 links, 1 backlinks)
- Network programming (2 links, 0 backlinks)
Programming languages
- Coding (3 links, 23 backlinks)
- Python (2 links, 6 backlinks)
- Rust (3 links, 3 backlinks)
- Haskell (2 links, 2 backlinks)
- Lisp (2 links, 2 backlinks)
- C++ (2 links, 2 backlinks)
- Scala (2 links, 1 backlinks)
- Ruby (2 links, 1 backlinks)
- Javascript (2 links, 1 backlinks)
- Java (2 links, 1 backlinks)
- Assembly language (1 links, 1 backlinks)
- Nix (2 links, 0 backlinks)
Python
- Pytorch (2 links, 1 backlinks)
Quality diversity
- MAP-Elites (2 links, 2 backlinks)
Recurrent neural networks
- Echo-state networks (2 links, 3 backlinks)
- Backward RNN (1 links, 0 backlinks)
- Cellular automata as recurrent neural networks (3 links, 0 backlinks)
Reinforcement learning
- Reinforcement learning with human feedback (2 links, 4 backlinks)
- Quality diversity (4 links, 4 backlinks)
- MAP-Elites (2 links, 2 backlinks)
- Decision transformer (3 links, 1 backlinks)
- Intrinsic motivation (2 links, 0 backlinks)
- Time to threshold (2 links, 0 backlinks)
- Reinforcement learning with verifiable rewards (4 links, 0 backlinks)
- Gato (2 links, 0 backlinks)
- Trajectory transformer (4 links, 0 backlinks)
Retrieval augmented generation
- Contrastive learning (4 links, 1 backlinks)
RoBERTa
- XLM-RoBERTa (3 links, 0 backlinks)
Robotics
- Intrinsic motivation (2 links, 0 backlinks)
Search
- Neural architecture search (7 links, 7 backlinks)
- Novelty search (1 links, 3 backlinks)
- Picbreeder (2 links, 1 backlinks)
Search algorithms
- Quality diversity (4 links, 4 backlinks)
Self-organization
- Amorphous computing (4 links, 0 backlinks)
Self-supervised learning
- Foundation models (7 links, 4 backlinks)
Semantic similarity
- Contrastive learning (4 links, 1 backlinks)
Signal processing
- Image processing (3 links, 4 backlinks)
- Fourier transform (2 links, 0 backlinks)
- Compressed sensing (2 links, 0 backlinks)
- Wavelets (3 links, 0 backlinks)
- Radon transform (1 links, 0 backlinks)
Society
- Economics (1 links, 21 backlinks)
- Privacy (1 links, 2 backlinks)
- Surveillance (2 links, 0 backlinks)
- Woke (1 links, 0 backlinks)
Statistical physics
- Boltzmann brain (4 links, 0 backlinks)
Statistics
- Noise (2 links, 3 backlinks)
- Bias-variance tradeoff (2 links, 1 backlinks)
- Statistical physics (2 links, 1 backlinks)
- Benford’s law (1 links, 0 backlinks)
- Simpson’s paradox (1 links, 0 backlinks)
- Causal inference (1 links, 0 backlinks)
T5
- Switch transformer (3 links, 2 backlinks)
- Megatron (4 links, 1 backlinks)
- Imagen (7 links, 0 backlinks)
Taxation
- Carbon tax (4 links, 1 backlinks)
- Land-value tax (2 links, 0 backlinks)
The Scaling Hypothesis
- Scaling laws (4 links, 2 backlinks)
Theory of computation
- Finite state machines (3 links, 2 backlinks)
Transfer learning
- Distillation (3 links, 6 backlinks)
- Few-shot learning (4 links, 4 backlinks)
- Synthetic training data (5 links, 1 backlinks)
- Zero-shot learning (4 links, 1 backlinks)
- Time to threshold (2 links, 0 backlinks)
Transformer-XL
- XLNet (4 links, 0 backlinks)
Transformers
- GPT (4 links, 22 backlinks)
- BERT (2 links, 12 backlinks)
- GPT-3 (5 links, 8 backlinks)
- GPT-2 (2 links, 6 backlinks)
- Vision transformer (3 links, 5 backlinks)
- T5 (3 links, 3 backlinks)
- CLIP (5 links, 3 backlinks)
- Chinchilla (4 links, 2 backlinks)
- PaLM (2 links, 2 backlinks)
- BART (3 links, 2 backlinks)
- Transformer-XL (2 links, 2 backlinks)
- Switch transformer (3 links, 2 backlinks)
- GPTInstruct (5 links, 1 backlinks)
- Gopher (5 links, 1 backlinks)
- Decision transformer (3 links, 1 backlinks)
- BlenderBot 3 (4 links, 1 backlinks)
- DALL-E (4 links, 1 backlinks)
- GLaM (2 links, 1 backlinks)
- Megatron (4 links, 1 backlinks)
- Positional encoding (2 links, 1 backlinks)
- OPT: Open Pre-trained Transformer (5 links, 1 backlinks)
- DistillBERT (4 links, 1 backlinks)
- RoBERTa (3 links, 1 backlinks)
- LAMDA (2 links, 0 backlinks)
- ALBERT (3 links, 0 backlinks)
- Wu Dao 2.0 (3 links, 0 backlinks)
- CTRL (2 links, 0 backlinks)
- DialoGPT (4 links, 0 backlinks)
- Imagen (7 links, 0 backlinks)
- Global context ViT (4 links, 0 backlinks)
- ELECTRA (2 links, 0 backlinks)
- Big bird (4 links, 0 backlinks)
- Flamingo (5 links, 0 backlinks)
- mBART (3 links, 0 backlinks)
- ERNIE (3 links, 0 backlinks)
- Swin Transformer (4 links, 0 backlinks)
- Turing-NLG (5 links, 0 backlinks)
- BLOOM (5 links, 0 backlinks)
- DQ-BART (4 links, 0 backlinks)
- SeeKer (2 links, 0 backlinks)
- Jurassic-1 (4 links, 0 backlinks)
- Sparrow (4 links, 0 backlinks)
- Pegasus (2 links, 0 backlinks)
- DALL-E-2 (5 links, 0 backlinks)
- XLNet (4 links, 0 backlinks)
- GPT-Neo (5 links, 0 backlinks)
- Minerva (3 links, 0 backlinks)
- Gato (2 links, 0 backlinks)
- Trajectory transformer (4 links, 0 backlinks)
- ChatGPT (7 links, 0 backlinks)
- XLM-RoBERTa (3 links, 0 backlinks)
Turing-completeness
- Turing completeness of cellular automata (4 links, 2 backlinks)
- Surprisingly Turing-Complete (5 links, 1 backlinks)
Unconventional computing
- Reservoir computing (8 links, 6 backlinks)
- Chaos computing (1 links, 0 backlinks)
- Amorphous computing (4 links, 0 backlinks)
- Computing in cellular automata (7 links, 0 backlinks)
Unsupervised learning
- Reservoir computing (8 links, 6 backlinks)
- Echo-state networks (2 links, 3 backlinks)
ViT
- Global context ViT (4 links, 0 backlinks)
- Swin Transformer (4 links, 0 backlinks)
Vision transformer
- Vision Language Models (5 links, 1 backlinks)
Writing
- Org-roam (5 links, 1 backlinks)
- Org-mode (2 links, 1 backlinks)
- Roam research (1 links, 1 backlinks)
- Note-taking (2 links, 0 backlinks)
- You and your research (1 links, 0 backlinks)
- PDF (1 links, 0 backlinks)
Uncategorized
- Algorithmic Information theory
- Art
- Artificial Intelligence
- Artificial life
- Berry’s paradox
- Biological life
- C Programming language
- Complexity
- Compression
- Computability theory
- Computer science
- Computer security
- Dirichlet energy
- Downs–Thomson paradox
- ELisp
- Epistasis
- Epsilon machines
- Europe
- Genetic algorithms
- Hadamard product
- Haskell Curry
- Information theory
- Jethro Kuan
- John Von Neumann
- Kenneth Stanley
- Konrad Zuse
- Language
- Logic
- Marvin Minsky
- Mathematics
- Melanie Mitchell
- Network authentication
- Philosophy
- Physics
- Rice’s theorem
- Richard Sutton
- Self-organization
- Self-replication
- Society
- Talk: Artificial Intelligence: A Guide for Thinking Humans
- Unconventional computing
- Urban science
- Writing
Paper Notes
| Citation Key | Title | Tags | Has Summary |
|---|---|---|---|
| schmidhuberComputerScientistView1999 | A Computer Scientist’s View of Life, the Universe, and Ev… | Zuse’s thesis | yes |
| raimbaultModelUrbanEvolution2020 | A model of urban evolution based on innovation diffusion … | ALife 2020, Complex Systems, Evolution, Urban science | yes |
| sayamaNewStructurallyDissolvable1999 | A new structurally dissolvable self-reproducing loop evol… | Cellular automata, Evolution | yes |
| cluneAIGAsAIgeneratingAlgorithms2019 | AI-GAs: AI-generating algorithms, an alternate paradigm f… | Artificial Intelligence, Genetic algorithms, Open-ended Evolution | yes |
| tutumAdaptingUnseenEnvironments2020 | Adapting to Unseen Environments through Explicit Represen… | Meta-learning, Reinforcement learning, ALife 2020 | yes |
| beerIntegratedPerspectiveConstitutive2020 | An Integrated Perspective on the Constitutive and Interac… | Emergence, Life, Cellular automata | yes |
| chenAttentionResiduals2026 | Attention Residuals by Kimi Team, Guangyu Chen, Yu Zhang,… | Transformers, LLM, Scaling laws, Attention, Residual neural networks | yes |
| quCORALAutonomousMultiAgent2026 | CORAL: Towards Autonomous Multi-Agent Evolution for Open-… | Open-ended evolution, Co-evolution, Quality diversity | yes |
| gilpinCellularAutomataConvolutional2018 | Cellular automata as convolutional neural networks by Gil… | Cellular automata as CNNs | yes |
| benderClimbingNLUMeaning2020 | Climbing towards NLU: On Meaning, Form, and Understanding… | NLP, Artificial Intelligence, Evaluating NLP | yes |
| kruszewskiCombinatoryChemistrySimple2020 | Combinatory Chemistry: Towards a Simple Model of Emergent… | Artificial life, Combinatory logic | yes |
| mcsheaComplexityEvolutionWhat1991 | Complexity and evolution: What everybody knows by McShea,… | Evolution, Complexity | yes |
| pathakCuriosityDrivenExplorationSelfSupervised2017 | Curiosity-Driven Exploration by Self-Supervised Predictio… | Reinforcement learning | no |
| lehreDevelopmentalMappingsPhenotypic2003 | Developmental mappings and phenotypic complexity by Lehre… | Cellular automata | yes |
| brantDiversityPreservationMinimal2020 | Diversity preservation in minimal criterion coevolution t… | Co-evolution, Evolutionary algorithms | yes |
| huDrinkingFirehoseContinual2020 | Drinking from a Firehose: Continual Learning with Web-sca… | Continual learning | no |
| phamEfficientNeuralArchitecture2018 | Efficient Neural Architecture Search via Parameter Sharin… | Neural architecture search | yes |
| zhangEmbarrassinglySimpleSelfDistillation2026 | Embarrassingly Simple Self-Distillation Improves Code Gen… | Distillation, Language modeling, Program synthesis, Large language models | yes |
| gershensonEmergenceArtificialLife2021 | Emergence in artificial life by Gershenson, C. (2021) | Artificial life, Emergence | no |
| nehanivEvolutionAsynchronousCellular2003 | Evolution in asynchronous cellular automata by Nehaniv, C… | Cellular automata, Evolution | yes |
| patteeEvolvedOpenEndednessNot2019 | Evolved Open-Endedness, Not Open-Ended Evolution by Patte… | yes | |
| stanleyEvolvingNeuralNetworks2002 | Evolving Neural Networks through Augmenting Topologies by… | Neural networks, Genetic algorithms, NAS | yes |
| millerEvolvingSelfrepairingSelfregulating2004 | Evolving a self-repairing, self-regulating, French flag o… | Cellular automata, Self-organization, Evolutionary strategies | yes |
| flageatFastStableMAPElites2020 | Fast and stable MAP-Elites in noisy domains using deep gr… | ALife 2020, MAP-Elites, Quality diversity | yes |
| adamsFormalDefinitionsUnbounded2017 | Formal Definitions of Unbounded Evolution and Innovation … | Open-ended Evolution, Cellular automata | no |
| chngGARFGaussianActivated2022 | GARF: Gaussian Activated Radiance Fields for High Fidelit… | Implicit neural representations, NeRF | no |
| leeGeckoVersatileText2024 | Gecko: Versatile Text Embeddings Distilled from Large Lan… | NLP, LLM, Semantic similarity | yes |
| aachGeneralizationDifferentCellular2021 | Generalization over different cellular automata rules lea… | Cellular automata, Neural networks | no |
| ainsworthGitReBasinMerging2022 | Git Re-Basin: Merging Models modulo Permutation Symmetrie… | Neural networks | yes |
| mordvintsevGrowingNeuralCellular2020 | Growing Neural Cellular Automata by Mordvintsev, A., Rand… | Cellular automata | yes |
| ramsauerHopfieldNetworksAll2020 | Hopfield Networks is All You Need by Ramsauer, H., Schäfl… | Hopfield Networks, Attention | yes |
| voitaInformationTheoreticProbingMinimum2020 | Information-Theoretic Probing with Minimum Description Le… | Evaluating NLP, Transformers, Minimum description length | yes |
| brooksIntelligenceRepresentation1991 | Intelligence without representation by Brooks, R. A. (1991) | Artificial Intelligence | no |
| reinkeIntrinsicallyMotivatedDiscovery2020 | Intrinsically Motivated Discovery of Diverse Patterns in … | yes | |
| yangLargeLanguageModels2023 | Large Language Models as Optimizers by Yang, C., Wang, X…. | Optimization, Machine learning, Natural language processing | yes |
| tancikLearnedInitializationsOptimizing2021 | Learned Initializations for Optimizing Coordinate-Based N… | Neural radiance fields, Meta-learning | no |
| zophLearningTransferableArchitectures2018 | Learning Transferable Architectures for Scalable Image Re… | NAS | yes |
| voelkerLegendreMemoryUnits2019 | Legendre Memory Units: Continuous-Time Representation in … | Recurrent neural networks | yes |
| wuMemorizingTransformers2022 | Memorizing Transformers by Wu, Y., Rabe, M. N., Hutchins,… | Transformers, Memory in neural networks | yes |
| leeMetaHarnessEndtoEnd2026 | Meta-Harness: End-to-End Optimization of Model Harnesses … | Machine learning, Optimization, Meta-learning, Program synthesis | yes |
| minimaxScalingTestTimeCompute2025 | MiniMax-M1: Scaling Test-Time Compute Efficiently with Li… | Foundation models, Reinforcement learning, Transformers, Scaling laws | yes |
| wierstraModelingSystemsInternal2005 | Modeling systems with internal state using evolino by Wie… | Genetic algorithms, Recurrent neural networks | yes |
| maziarkaMoleculeAttentionTransformer2020 | Molecule Attention Transformer by Maziarka, Ł., Danel, T…. | Neural networks | yes |
| andersonMoreDifferent1972 | More Is Different by Anderson, P. W. (1972) | Complexity, Philosophy | no |
| yeNetworkDeconvolution2020 | Network Deconvolution by Ye, C., Evanusa, M., He, H., Mit… | Convolutional neural networks, Neural network training | yes |
| zophNeuralArchitectureSearch2017 | Neural Architecture Search with Reinforcement Learning by… | NAS | yes |
| lechnerNeuralCircuitPolicies2020 | Neural Circuit Policies Enabling Auditable Autonomy by Le… | Neural networks | no |
| floreanoNeuroevolutionArchitecturesLearning2008 | Neuroevolution: from architectures to learning by Florean… | NAS | yes |
| gauthierNextGenerationReservoir2021 | Next Generation Reservoir Computing by Gauthier, D. J., B… | Reservoir computing | no |
| xiongNystrOmformerNystr2021 | Nyströmformer: A Nyström-Based Algorithm for Approximatin… | Transformers | yes |
| beckhamAdversarialMixupResynthesis2019 | On Adversarial Mixup Resynthesis by Beckham, C., Honari, … | Autoencoders | yes |
| felleisenExpressivePowerProgramming1991 | On the expressive power of programming languages by Felle… | Programming languages | no |
| yangOneModelLearning2022 | One model for the learning of language by Yang, Y., & Pia… | NLP, Artificial Intelligence, Machine learning | no |
| khalifaPCGRLProceduralContent2020 | PCGRL: Procedural Content Generation via Reinforcement Le… | Reinforcement learning | yes |
| wangPOETOpenendedCoevolution2019 | POET: open-ended coevolution of environments and their op… | Open-ended Evolution, Reinforcement learning | yes |
| luPretrainedTransformersUniversal2021 | Pretrained Transformers as Universal Computation Engines … | Transformers | no |
| horibeRegeneratingSoftRobots2021 | Regenerating Soft Robots through Neural Cellular Automata… | Cellular automata, Reinforcement learning | yes |
| hubotterReinforcementLearningSelfDistillation2026 | Reinforcement Learning via Self-Distillation by Hübotter,… | Reinforcement learning, Distillation, Large language models, In-context learning | yes |
| jensenReservoirComputingArtificial2020 | Reservoir Computing in Artificial Spin Ice by Jensen, J. … | Reservoir computing, Complex Systems | yes |
| dongReservoirComputingMeets2020 | Reservoir Computing meets Recurrent Kernels and Structure… | Reservoir computing, Kernel Methods | no |
| cikaResilientLifeExploration2020 | Resilient Life: An Exploration of Perturbed Autopoietic P… | ALife 2020, Cellular automata, Autopoiesis | yes |
| grbicSafeReinforcementLearning2020 | Safe Reinforcement Learning through Meta-learned Instinct… | Meta-learning, Reinforcement learning, ALife 2020 | yes |
| greydanusScalingDeepLearning2020 | Scaling down Deep Learning by Greydanus, S. (2020) | Neural networks | no |
| sayamaSeekingOpenendedEvolution2011 | Seeking open-ended evolution in Swarm Chemistry by Sayama… | Open-ended Evolution | yes |
| horowitzSpontaneousFinetuningEnvironment2017 | Spontaneous fine-tuning to environment in many-species ch… | Chemical reaction network, Biological life | yes |
| simonArchitectureComplexity1962 | The Architecture of Complexity by Simon, H. A. (1962) | Complexity, Complex Systems | no |
| aitkenGeometryIntegrationText2020 | The geometry of integration in text classification RNNs b… | RNN, NLP | no |
| krakauerInformationTheoryIndividuality2020 | The information theory of individuality by Krakauer, D., … | Information theory, Life | yes |
| weissThinkingTransformers2021 | Thinking Like Transformers by Weiss, G., Goldberg, Y., & … | NLP, Computer science | no |
| leeTrainingLanguageModels2026 | Training Language Models via Neural Cellular Automata by … | Cellular automata, Neural cellular automata, Transfer learning, Kolmogorov complexity | yes |
| katharopoulosTransformersAreRNNs2020 | Transformers are RNNs: Fast Autoregressive Transformers w… | Transformers, RNN | yes |
| liTransitionPhenomenaCellular1990 | Transition phenomena in cellular automata rule space by L… | Cellular automata | yes |
Statistics
- Total notes: 517
- Concept notes: 445
- Paper notes: 72
- Orphan notes (no incoming links): 153
- Broken links: 0
- Average links per note: 2.9
Link Graph Summary
Most Connected Notes
- Transformers (66 backlinks)
- NLP (58 backlinks)
- Neural networks (58 backlinks)
- Machine learning (57 backlinks)
- Cellular automata (51 backlinks)
- Artificial Intelligence (31 backlinks)
- Evolution (27 backlinks)
- Reinforcement learning (24 backlinks)
- Complex Systems (24 backlinks)
- Biological life (23 backlinks)
- Recurrent neural networks (23 backlinks)
- Computer science (23 backlinks)
- Coding (23 backlinks)
- Applied maths (23 backlinks)
- GPT (22 backlinks)
Orphan Notes (no incoming links)
- AI and climate change
- AI capitalism
- ALBERT
- Abelian sandpile model
- Adaptive Computation Time
- Algorithmic probability
- Amorphous computing
- Arithmetic coding
- Art with Cellular Automata
- Article: The Cartoon Picture of Magnets That Has Transformed Science
- Article: The End of the RNA World Is Near, Biochemists Argue
- Article: Uncertain times
- Article: What Is an Individual? Biology Seeks Clues in Information Theory.
- Article: Why Sex? Biologists Find New Explanations
- Asset economy
- Automated discovery in complex systems
- Automatic differentiation
- Automation
- BLOOM
- Backward RNN
- Batteries
- Benford’s law
- Berry’s paradox
- Big bird
- Blue noise
- Boltzmann brain
- Bongard problems
- CMA-ES
- CTRL
- Carbon capture
- Carbon offsetting
- Catastrophic forgetting
- Causal inference
- Cellular automata as recurrent neural networks
- Cellular neural networks
- Chaos computing
- ChatGPT
- Church-Turing thesis
- Complexity of cellular automata
- Compressed sensing
- Computing in cellular automata
- Creative coding
- Crosshatch automata
- DALL-E-2
- DQ-BART
- DialoGPT
- Diffusion limited aggregation
- Dirichlet energy
- ELECTRA
- ERNIE
- Edge detection
- Einops
- Emergence in artificial life
- Extractivism
- Fast Marching method
- Flamingo
- Fourier transform
- Fractional calculus
- Frank-Wolfe algorithm
- Futures contracts
- GPT-Neo
- Gato
- Gaussian Processes
- Giffen goods
- Gig economy
- Global context ViT
- Gradient descent for wide two-layer neural networks – I : Global convergence
- Graham scan
- Graph cellular automata
- Graph compression
- Greenhouse gas emissions
- Hadamard product
- Halting probability
- Hash functions
- Hilbert curve indexing
- Homomorphic encryption
- Huffman coding
- Illegal numbers
- Imagen
- Intrinsic motivation
- Jevons paradox
- Jurassic-1
- Kaya identity
- Kernel Machine
- Knowledge argument
- Knuth-Morris-Pratt string-searching algorithm
- Kuznets curve
- L-Systems
- LAMDA
- Land-value tax
- Levenshtein automata
- Linear programming
- Locality-Sensitive Hashing
- Make
- Matrix factorization
- Mean field theory of neural networks (talk)
- Minerva
- Motion planning
- Neoliberalism
- Network programming
- Neural cellular automata and implicit representations
- Neural networks as dynamical systems
- Neural tangent kernel
- Nix
- Note-taking
- Optimal control
- Pattern-defeating quicksort
- Pegasus
- Projection on convex sets
- Quantization
- Rademacher complexity
- Radon transform
- Rainbow tables
- Raven’s progressive matrices
- Reinforcement learning with verifiable rewards
- Resource curse
- Ring signatures
- Schmidhuber on Consciousness
- Sed utility
- SeeKer
- Semantic primes
- Simpson’s paradox
- Snake in the tunnel
- Softmax
- Sparrow
- Spatial Reasoning
- Ssh
- Stable marriage problem
- Style transfer
- Surveillance
- Swin Transformer
- System of linear equations
- Talk: Differentiation of black-box combinatorial solvers
- Talk: The Importance of Open-Endedness in AI and Machine Learning
- The Bitter Lesson
- The Meta-Problem of Consciousness with David Chalmers
- Time to threshold
- Trajectory transformer
- Tropical semiring
- Turing degree
- Turing-NLG
- Universal basic income
- Unker non-linear writing system
- Wavelets
- Why programming is a good medium for expressing poorly understood and sloppily-formulated ideas
- Woke
- Wu Dao 2.0
- XLM-RoBERTa
- XLNet
- You and your research
- mBART
- t-SNE
Loading comments...