Lessons
Explore all newline lessons
lesson
Tokenization deep dive - Byte-level language modeling vs traditional tokenizationAI bootcamp 2- Learn how byte-level models process raw UTF-8 bytes directly, with a vocabulary size of 256 - Understand how this approach removes the need for subword tokenizers like BPE or SentencePiece - Compare byte-level models to tokenized models with larger vocabularies (e.g., 30k–50k tokens) - Analyze the trade-offs between the two approaches in terms of simplicity - Evaluate how each approach handles multilingual text - Assess the impact on model size - Examine differences in performance
lesson
Tokens, Embeddings & Modalities — Foundations of Understanding Text, Image, and AudioAI Bootcamp- Understand the journey from raw text → tokens → token IDs → embeddings - Compare word-based, BPE, and advanced tokenizers (LLaMA, GPT-2, T5) - Analyze how good/bad tokenization affects loss, inference time, and semantic meaning - Learn how embedding vectors represent meaning and change with context - Explore and manipulate Word2Vec-style word embeddings through vector math and dot product similarity - Apply tokenization and embedding logic to multimodal models (CLIP, ViLT, ViT-GPT2) - Conduct retrieval and classification tasks using image and audio embeddings (CLIP, Wav2Vec2) - Discuss emerging architectures like Byte Latent Transformers and their implications
lesson
Text to Tokens to EmbeddingsAI BootcampUnderstand the journey from raw text to tokens to embeddings, compare tokenizers (word-based, BPE, LLaMA, GPT-2, T5), and analyze tokenization’s impact on loss and inference.
lesson
Securing a Svelte Application with JSON Web TokensFullstack SvelteSecuring the application with JSON Web Tokens
lesson
How to Create Design Tokens and Styles in FigmaThe newline Guide to React Component Design Systems with FigmagicLet's move on from basics to the intermediate level and actually make some designs.
lesson
An Intro to Figmagic, the Figma CLI For Token DesignThe newline Guide to React Component Design Systems with FigmagicFigmagic is the last piece in our toolchain that acts as the glue needed to super-charge your productivity.