A small list of small and tiny Generative AI models

--

I am especially interested in tiny modals as all my career I worked on large-scale applications (billions of queries per day with low latency requirements, billions of documents to be processed etc) — and large multi-billion parameter models will not fit such area due to costs and operational limits. Tiny models will be workhorses in the industry for many applications

TinyLLama https://lnkd.in/gbqDkydb

Small models from Stability AI https://lnkd.in/gYqzMTCw

Phi-2 https://lnkd.in/gFzGXiGA

Orca Math https://lnkd.in/gFjdUBYE

Some models from OpenFlamingo family https://lnkd.in/gv_xKm4Y

MobiLlama https://lnkd.in/gVX_ckg3

multi-modal Tiny GPTV https://lnkd.in/gFz_BcKu

multi-modal Miny GPT4 https://lnkd.in/gSJEZTuj

multi modal TinyLlava https://lnkd.in/g8wgqcZF

visual MobileVLM https://lnkd.in/gUJj8G_A

visual Moondream https://lnkd.in/gY8xeWca

--

--

Andrei Lopatenko
Andrei Lopatenko

Written by Andrei Lopatenko

VP Engineering in Zillow. Leading Search, Conversational, Voice AI, ML in Zillow, eBay, Walmart, Apple, Google, Recruit Holdings. Ph.D. in Computer Science

No responses yet