Uğur Ali Kaplan

Building, learning, wandering

ML engineer at Raynet. MSc Machine Learning from Tübingen, BSc Computer Engineering from Istanbul Technical University (İTÜ). I write about things I learn and take photos of things I see.

Recent Posts

Stanford CS336 Lecture Notes 3 - Architectures and Hyperparameters

Notes on transformer architectures, normalization strategies, positional embeddings (sinusoidal, absolute, relative, ALiBi, RoPE), activation functions, attention variants, and hyperparameter choices.

Stanford CS336 Lecture Notes 2 - Resource Accounting for Transformer Models

Notes on analyzing computation and memory cost of LLMs, with explanations on computation graphs and OpenAI's analysis on memory and compute requirements.

Principal Component Analysis and Loadings

Deriving PCA from the maximum variance point of view, explaining loadings, and applying PCA analysis on air quality measurements in Mersin, Turkey.

View all posts →