- tags
- Machine learning, NLP, Language modeling
A large language model, which is the name now given mostly to large Transformer based architecture with usually at least several billions of parameters Retrieval augmented generation
LLM
Links to this note
- Agent
- Agentic reinforcement learning
- Chain-of-Thought reasoning
- Coding agent
- Diffusion language models
- Foundation models
- Geospatial AI
- Grounding
- In-context learning
- Knowledge Base Index
- Mixture of Experts
- Model Context Protocol
- Multi-agent collaboration
- Notes on: Attention Residuals by Kimi Team, Guangyu Chen, Yu Zhang, Jianlin Su et al. (2026)
- Notes on: CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery by Ao Qu, Han Zheng, Zijian Zhou, Yihao Yan, Yihong Tang, Shao Yong Ong, Fenglu Hong, Kaichen Zhou, Chonghe Jiang, Minwei Kong, Jiacheng Zhu, Xuan Jiang, Sirui Li, Cathy Wu, Bryan Kian Hsiang Low, Jinhua Zhao, Paul Pu Liang (2026)
- Notes on: DFlash: Block Diffusion for Flash Speculative Decoding by Jian Chen, Yesheng Liang, Zhijian Liu (2026)
- Notes on: Embarrassingly Simple Self-Distillation Improves Code Generation by Zhang, R., Bai, R. H., Zheng, H., Jaitly, N., Collobert, R., & Zhang, Y. (2026)
- Notes on: Gecko: Versatile Text Embeddings Distilled from Large Language Models by Jinhyuk Lee, et al. (2024)
- Notes on: LoRA Learns Less and Forgets Less by Dan Biderman, Jacob Portes, Jose Javier Gonzalez Ortiz, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John P. Cunningham (2024)
- Notes on: Reinforcement Learning via Self-Distillation by Hübotter, J., Lübeck, F., Behric, L., Baumann, A., Bagatella, M., Marta, D., Hakimi, I., Shenfeld, I., Kleine Buening, T., Guestrin, C. & Krause, A. (2026)
- Notes on: Training Language Models via Neural Cellular Automata by Dan Lee, Seungwook Han, Akarsh Kumar, Pulkit Agrawal (2026)
- Reinforcement learning with verifiable rewards
- Retrieval augmented generation
- Scaling laws
- Self-training
- Spatial Reasoning
- Speculative Decoding
- Synthetic training data
- Test-time compute
- Tool calling
- Vision Language Models
Last changed | authored by Hugo Cisneros
Loading comments...