📘 Index
⌘K to search
Computer Science
📁📂 Data Structures & Algorithms
📘 Index: Data Structures & Algorithms
📁📂 Leetcode Patterns
📘 Index: Leetcode Patterns 📄 Arrays and Hashing 📄 Two Pointers 📄 Stack 📄 Binary Search 📄 Sliding Window 📄 Trees
📄 1: Graphs and Representations 📄 2: Graph Search 📄 3: Minimum Spanning Trees 📄 4: Union-Find 📄 5: Hash Tables 📄 6: Balanced Binary Search Trees 📄 7: Priority Queues and Heaps 📄 8: Tries 📄 9: Divide and Conquer 📄 10: Greedy Algorithms 📄 11: Dynamic Programming 📄 12: Network Flows 📄 13: Linear Programming 📄 14: NP-Completeness 📄 15: Approximation Algorithms 📄 16: Randomized Algorithms
📁📂 Firefox
📘 Index: Firefox
📁📂 Clear Data Dialog
📘 Index: Clear Data Dialog 📄 Removing the Old Dialog 📄 Dead Code Cleanup 📄 Loading Indicator
📁📂 Community Engagement
📘 Index: Community Engagement 📄 Mozilla Engineering Talks + Networking
📁📂 Notifications Telemetry Pipeline
📘 Index: Notifications Telemetry Pipeline 📄 Notification Permission Telemetry
📁📂 Copy Clean Link
📘 Index: Copy Clean Link 📄 Stripping the _gl Parameter 📄 Stripping Audible Tracking Parameters 📄 Clean Copy as Default Preference
📁📂 Privacy Metrics Widget
📘 Index: Privacy Metrics Widget 📄 Privacy Metrics Service 📄 Privacy Metrics Component 📄 Top Trackers Database 📄 Nova Redesign & New Tab Integration
📁📂 SmartBlock
📘 Index: SmartBlock 📄 Embed Link Preservation 📄 Facebook Post Shim
📁📂 Privacy Alignment
📘 Index: Privacy Alignment 📄 Android ETP Pipeline 📄 Sphinx ETP Extension 📄 Private Browsing Cell Clarification 📄 Pref Comment Cleanup 📄 Strict Mode Fix
📁📂 Predicting the Cost of Blocked Tracker Requests from Pre-Response Features
📘 Predicting the Cost of Blocked Tracker Requests from Pre-Response Features 📄 Data Exploration and Visualization 📄 Hand-Crafted Features and Tree Models 📄 Learned URL Representations 📄 Firefox ONNX Inference
📁📂 Linear Algebra
📘 Index: Linear Algebra 📄 1: Re-imagining Matrices 📄 2: Solving Linear Systems 📄 3: Vectors in Euclidian Space 📄 4: Matrix Operations 📄 5: Matrix Transformations as Functions 📄 6: Subspaces 📄 7: Kernel and Image 📄 8: Orthogonality and Projections 📄 9: The Determinant 📄 10: Eigenvalues and Eigenvectors 📄 11: Diagonalization and Similarity 📄 12: Orthogonal Diagonalization and the Spectral Theorem 📄 13: Singular Value Decomposition 📄 14: Portfolio Optimization 📄 15: PCA in Finance 📄 16: Covariance Estimation and Regularization
📁📂 Machine Learning
📘 Index: Machine Learning
📁📂 01 K-Nearest Neighbors
📘 Index: 01 K-Nearest Neighbors 📄 K-Nearest Neighbors 📄 Experiment: MNIST Digit Classification
📁📂 03 Linear Regression
📘 Index: 03 Linear Regression 📄 Linear Regression 📄 Gradient Descent 📄 Experiment: Gradient Descent 📄 Practice Problems
📁📂 02 Decision Trees
📘 Index: 02 Decision Trees 📄 Decision Trees 📄 Experiment: Heart Disease Prediction
📁📂 04 Logistic Regression and Regularization
📘 Index: 04 Logistic Regression and Regularization 📄 Logistic Regression and Regularization
📁📂 05 Neural Networks
📘 Index: 05 Neural Networks 📄 Neural Networks
📁📂 06 Backpropagation
📘 Index: 06 Backpropagation 📄 Backpropagation
📁📂 07 Bias-Variance Tradeoff and Bagging
📘 Index: 07 Bias-Variance Tradeoff and Bagging 📄 Bias-Variance Tradeoff and Bagging
📁📂 08 Naive Bayes
📘 Index: 08 Naive Bayes 📄 Naive Bayes
📁📂 09 Gaussian Discriminant Analysis
📘 Index: 09 Gaussian Discriminant Analysis 📄 Gaussian Discriminant Analysis
📁📂 Gradient Boosting
📘 Index: Gradient Boosting 📄 Gradient Boosting
📁📂 10 Painting Classifier
📘 Index: 10 Painting Classifier 📄 Experiment: Painting Classifier 📄 Feature Engineering Pipeline 📄 Model Comparison: Logistic Regression vs Random Forest vs MLP
📁📂 Transformers and Attention
📘 Index: Transformers and Attention 📄 Transformers and Attention
📁📂 Large Language Models
📘 Index: Large Language Models 📄 Large Language Models
📁📂 Retrieval Augmented Generation
📘 Index: Retrieval Augmented Generation 📄 Retrieval Augmented Generation
📁📂 Model Evaluation and Experiment Design
📘 Index: Model Evaluation and Experiment Design 📄 Model Evaluation and Experiment Design
📁📂 Fine-Tuning and Parameter-Efficient Methods
📘 Index: Fine-Tuning and Parameter-Efficient Methods 📄 Fine-Tuning and Parameter-Efficient Methods
📁📂 Feature Engineering and Embeddings
📘 Index: Feature Engineering and Embeddings 📄 Feature Engineering and Embeddings
📁📂 Loss Functions and Optimization
📘 Index: Loss Functions and Optimization 📄 Loss Functions and Optimization
📁📂 ML Systems Design
📘 Index: ML Systems Design 📄 ML Systems Design
📁📂 MarkUs
📘 Index: MarkUs 📄 MarkUs: Testing 📄 MarkUs: Framework Maintenance 📄 MarkUs: Performance 📄 MarkUs: Model Architecture 📄 MarkUs: Scheduled Visibility (Backend) 📄 MarkUs: Scheduled Visibility (Frontend) 📄 MarkUs: Touch Annotations
📁📂 Multivariable Calculus
📘 Index: Multivariable Calculus 📄 1: Parametric Equations / Polar Coordinates 📄 2: Vectors 📄 3: Vector Functions and Space Curves 📄 4: Differential Calculus of Several Variables 📄 5: Integral Calculus of Several Variables 📄 6: Line Integrals 📄 7: Surface Integrals 📄 8: Vector Calculus Theorems
📁📂 PythonTA
📘 Index: PythonTA 📄 PythonTA
📁📂 Software Design
📘 Index: Software Design 📄 Object-Oriented Programming in Python 📄 SOLID Principles 📄 Design Patterns
📁📂 Statistics
📘 Index: Statistics 📄 1: Probability Review 📄 2: Statistical Models 📄 3: Estimators & Properties 📄 4: Method of Moments 📄 5: Maximum Likelihood Estimation 📄 6: Confidence Intervals 📄 7: Hypothesis Testing 📄 8: Likelihood Ratio Tests 📄 9: The Linear Model 📄 10: Inference for Linear Models
📁📂 frontend
📘 Index: frontend 📄 0: Vanilla JS Crash Course 📄 1: React Quick Start 📄 2: React Practice Components 📄 3: React Intermediate 📄 4: React Advanced Concepts 📄 5: Intermediate Practice Components 📄 6: Interview Simulation Components 📄 7: Data Wrangling with JavaScript
Writing and Music
📁📂 Essays
📘 Index: Essays 📄 A Farewell to Arms (Ernest Hemingway, 1929) 📄 Faith, Silence, and Artistic Labor in Tarkovsky's Andrei Rublev 📄 Sincerity Under Institutional Constraint: Soviet VIA Music at Bagram 📄 Before the Music Stops 📄 Coordination Without Authority: Zhang Zuolin and the Fengtian Clique 📄 Discontinuous Utility and the Jutland Paradox 📄 Я могу говорить 📄 Unreliable Narration as Historical Method in Jiang Wen's In the Heat of the Sun 📄 Endogenous Reform Destruction and Recursive Institutional Failure in the Soviet Economic System 📄 Manufactured Enmity and Institutional Paralysis in Tanović's No Man's Land 📄 Red Star Over China (Edgar Snow, 1937) 📄 Gaidai's Shurik and the Social Function of Soviet Comedy 📄 The Feeling You Can't Verify
📁📂 US Government
📘 Index: US Government
📁📂 1-Foundations
📘 Index: 1-Foundations 📄 Democratic Ideals & Types of Democracy 📄 Federalists vs. Anti-Federalists 📄 The Constitutional Convention 📄 Separation of Powers & Checks and Balances 📄 Federalism
📁📂 3-Civil-Liberties
📘 Index: 3-Civil-Liberties 📄 The Bill of Rights and Selective Incorporation 📄 First Amendment: Religion and Speech 📄 Press, Assembly, and the Right to Bear Arms 📄 Due Process, Criminal Rights, and Privacy 📄 Civil Rights and Equal Protection
📁📂 2-Branches
📘 Index: 2-Branches 📄 Congress: Structure and Powers 📄 Congressional Behavior 📄 The Presidency 📄 The Judiciary 📄 The Bureaucracy
📁📂 4-Political-Ideologies
📘 Index: 4-Political-Ideologies 📄 Political Socialization 📄 Measuring Public Opinion 📄 American Political Ideologies 📄 Ideology and Economic Policy 📄 Ideology and Social Policy
📁📂 5-Political-Participation
📘 Index: 5-Political-Participation 📄 Voting Rights and Turnout 📄 Political Parties 📄 Interest Groups and Lobbying 📄 Elections: Presidential and Congressional 📄 Campaigns, Finance, and Media
📁📂 Effective Goal Setting
📘 Index: Effective Goal Setting 📄 A Model for Goal Setting 📄 Fat Tails in Value 📄 Taking Asymmetric Bets 📄 The Psychology of Failure 📄 The Framework
📁📂 Music
📘 Index: Music 📄 Yankee Hotel Foxtrot and What It Still Means to Be American 📄 Unknown Pleasures and the Sound of a City Losing Its Nerve Endings
Athletics
📁📂 National Qualifiers 2027
📘 Index: National Qualifiers 2027 📄 Week 1: Mar 16 - Mar 22 📄 Week 2: Mar 23 - Mar 29 📄 Week 3: Mar 30 - Apr 5 📄 Week 4: Apr 6 - Apr 12 📄 Week 5: Apr 13 - Apr 19 📄 Week 6: Apr 20 - Apr 26 📄 Week 7: Apr 27 - May 3 📄 Week 8: May 4 - May 10 📄 Week 9: May 11 - May 17 📄 Week 10: May 18 - May 24 📄 Week 11: May 25 - May 31 📄 Week 12: Jun 1 - Jun 7 📄 Week 13: Jun 8 - Jun 14 📄 Week 14: Jun 15 - Jun 21 📄 Week 15: Jun 22 - Jun 28 📄 Week 16: Jun 29 - Jul 5
📁📂 Sleep & Nutrition
📘 Index: Sleep & Nutrition 📄 Sleep Protocol 📄 Nutrition Protocol
Changelog | | Resume
← home / machine-learning / Index: Transformers and Attention

Index: Transformers and Attention

Articles

  1. Transformers and Attention
PreviousModel Comparison: Logistic Regression vs Random Forest vs MLP
NextTransformers and Attention
Type to search