yeswondwerr

hey, my names nicolas. i usually get nerdsniped by many things so my projects are pretty varied.

ive done open source replicas of some popular software, like HeyGen. ive also done some little projects to try and prove my ideas, such as fixable speculative decoding, diffusion to text before it was cool and low memory kron psgd variants

curently doing ml/hpc stuff at andromeda

• a sota (at the time) vlm llama-3-vision-alpha
• torchtitan fork for depth gated moes and decomposable qkv here
• moe compressed writeup

if you need anything, just shoot me a dm on twitter (and send me cool music PLEASE). thanks for visiting :)