Hi, I'm Tyler
I'm a research engineer focused on interpretability and ML infrastructure.
Currently finishing my MSCS at Georgia Tech (ML & Computing Systems) while doing alignment research with SPAR and MARS. Previously a Senior SWE & Team Lead for 7 years. My work spans mechanistic interpretability, GPU systems, and building the tooling that makes safety research possible at scale.
Writing
- -
Same Parts, Different Wiring: Mechanistic Interpretability of Moral Fine-Tuning 49 min read An exploration of how moral fine-tuning changes LLMs
- -
CUDA Fundamentals: Tiled Matrix Multiply & Bitonic Sort 17 min read Writing real GPU kernels, exploring shared memory tiling, parallel sorting algorithms, and performance optimization on an NVIDIA H100.
- -
GPU Simulation: Warp Scheduling & Compute/Tensor Cores 17 min read Building a cycle-level GPU simulator from the inside, implementing GTO and CCWS warp schedulers, modeling compute instruction latencies, and extending to tensor core simulation.
- -
Static Analysis: Detecting Branch Divergence in GPU Code 15 min read A simple if statement can halve GPU throughput, exploring how static dataflow analysis detects branch divergence by building a def-use chain over a SASS control flow graph.
- -
FlashAttention & LLM Inference on GPUs 19 min read Writing a FlashAttention CUDA kernel from scratch, tiling the attention matrix to avoid materializing N×N memory, building a KV cache for token generation, and running GPT-2 with custom kernels end-to-end.
- -
GPU Hardware and Software 29 min read What I Learned in GPU Hardware and Software (CS 8803) - A Retrospective
- -
Notes on Effective ML Research 9 min read A summary of my takeaways from three influential articles on conducting effective empirical AI alignment research.
- -
Using uv: A Modern Python Workflow 9 min read An introduction to uv, a fast, Rust-based tool for Python packaging
- -
BlueDot AI Safety Evals Paper Club Notes 34 min read My notes and takeaways from the BlueDot AI Safety Evals paper club, covering recent papers on AI alignment, security, and evaluations.
- -
Hierarchical Reasoning Models 2 min read A talk exploring novel neural architectures for complex reasoning tasks, featuring two-level recurrence and adaptive computation.
- -
A Practical Guide to Supervised Learning 19 min read A conceptual walkthrough of the supervised learning process, covering data analysis, model evaluation, and the fundamental trade-offs involved in building effective classifiers.
- -
Machine Learning 70 min read A survey of concepts covered in my graduate Machine Learning course
- -
Reflections on ICML 2025 2 min read Some notes and observations from my time at the 2025 International Conference for Machine Learning (ICML)
- -
Concurrency and Parallelism 17 min read A dive into concurrency and parallelism across different levels of computer systems
- -
Building a Distributed File System: A Study in C++ 17 min read An exploration of remote communication, data consistency, and synchronization in a C++ distributed file system project.
- -
A Deep Dive into IPC with a Proxy-Cache Project 17 min read Exploring Inter-Process Communication and synchronization in C by building a high-performance proxy and cache.
- -
Building a Scalable Multithreaded File Server in C 16 min read A project that explores multithreading, sockets, and the basics of operating systems
- -
Graduate Introduction to Operating Systems 39 min read What I Learned in Graduate Introduction to Operating Systems (GIOS) - A Retrospective
- -
Master of Science in Computer Science 3 min read From biomedical engineering to machine learning: my journey through Georgia Tech's MSCS program
- -
Language Diffusion Survey 2 min read A talk surveying diffusion models for language, from DDPM foundations to modern mask diffusion competing with auto-regressive models.
- -
Semantic Search 6 min read What's an embedding vector, and how can we use neural networks to improve the relevance of search results?
- -
Knowledge Debt 💸 3 min read Tech debt, knowledge debt, and the kitchen sink.
- -
Language Models 10 min read From n-grams to ChatGPT, how language models work and how they can be used to solve real-world problems.
- -
Search Engine Fundamentals 8 min read Essential terms and concepts of how search works. Queries, indexes, & relevance.
- -
Bitwise Operators on Python Set and Dict 5 min read Bitwise or getting a bit wise? Quick post on quirky Python syntax for working with sets and dicts.
- -
Exponential Backoff and Jitter ⏳ 5 min read How to automaically retry requests and not blow stuff up
- -
The Hack Virtual Machine 6 min read Creating a virtual machine translator for the Nand2Tetris course
- -
A foray in Digital Gardens 👨🌾 2 min read Planting the seeds of my own digital garden
- -
From Boolean Logic Gates to an Assembler 8 min read The first half of the Nand2Tetris course
- -
Git Stash, save work for winter 🐿 4 min read Quick tips for using git stash.