yeswondwerr
hey, my names nicolas. i usually get nerdsniped by many things so my projects are pretty varied.
ive done open source replicas of some popular software, like HeyGen. ive also done some little projects to try and prove my ideas, such as fixable speculative decoding, diffusion to text before it was cool and low memory kron psgd variants
curently doing ml/hpc stuff at andromeda
other things that ive done:
- a sota (at the time) vlm llama-3-vision-alpha
- torchtitan fork for depth gated moes and decomposable qkv here
- moe compressed writeup
if you need anything, just shoot me a dm on twitter (and send me cool music PLEASE). thanks for visiting :)