← Browse all tags

NLP

Notes

ChatGPT

Reinforcement learning with human feedback

Semantic similarity

Machine translation

GPT

XLM-RoBERTa

Wu Dao 2.0

Turing-NLG

Transformer-XL

T5

Switch transformer

RoBERTa

Pegasus

PaLM

OPT: Open Pre-trained Transformer

mBART

LAMDA

Jurassic-1

Imagen

GPTInstruct

GPT-Neo

GLIDE

GPT-3

GLaM

Flamingo

ERNIE

ELECTRA

DQ-BART

DistillBERT

DialoGPT

ALBERT

BERT

BLOOM

CTRL

Big bird

CLIP

Chinchilla

Byte-pair encoding

Text classification

Language modeling

Word vectors

Notes on: One model for the learning of language by Yang, Y., & Piantadosi, S. T. (2022)

Notes on: Thinking Like Transformers by Weiss, G., Goldberg, Y., & Yahav, E. (2021)

Notes on: The geometry of integration in text classification RNNs by Aitken, K., Ramasesh, V. V., Garg, A., Cao, Y., Sussillo, D., & Maheswaranathan, N. (2020)

Notes on: Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data by Bender, E. M., & Koller, A. (2020)

Regular expressions

Projects

Architecture for the Posos challenge

Posos Challenge

My work on the Posos sentence classification challenge.

A DAG for a data-journalism example

Data journalism extractor

A large-scale data exploration tool for data journalism.

Screenshot of the mobile version of the app

Arxiv explorer

A small web app project for exploring Arxiv papers.