New York, New York, United States
Deeply experienced software architect, developer and entrepreneur with a focus on innovative technologies, machine learning, multiplayer video games, and online advertising.
Advancing and enhancing the RWKV series of Large Language Models, and creating innovations for hybrid transformers and beyond Research Papers and Projects: RWKV-5 and 6, "Eagle" and "Finch": RWKV with Matrix-Valued States and Dynamic Recurrence https://arxiv.org/abs/2404.05892 GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression https://arxiv.org/abs/2407.12077 RWKV-7 "Goose" with Expressive Dynamic State Evolution https://arxiv.org/abs/2503.14456 RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale https://arxiv.org/abs/2505.03005 EagleX enhanced RWKV-5 model Flock of Finches (RWKV-6 MoE) https://substack.recursal.ai/p/flock-of-finches-rwkv-6-mixture-of Q-RWKV series of attention-free models up to 72B https://huggingface.co/featherless-ai/Qwerky-72B
Co-founded and ran game development company. Acted as producer and lead developer, doing all clientside programming on Shadowtale Web MMO released Q4 2008, and all programming on Dungeon Punks, released mid-2016 on Playstation 4, Playstation Vita, Xbox One, Steam, and web.
Co-founded very large online games ad network. Personally created and scaled core ad serving and other technologies, serving billions of monthly impressions and promoting products from the largest MMO and PC game providers worldwide.
Responsible for technology and games for MTV Networks Online Games Group, which served the various MTV Networks channel sub-brands (MTV, VH1, Logo, Comedy Central, etc.) and created a wide variety of game content around exciting properties like Reno 911, South Park, and The Daily Show.
Co-founded and ran game development company. Created over 13 online multiplayer games, and co-developed our unique real-time action online multiplayer development platform. These games were featured on some of the biggest games websites of the era, and became the first multiplayer games featured inside the ICQ client. Won various awards, including Independent Games Festival Audience Choice for our innovative product Kung Fu Chess.