Post by ServiceNow AI Research

53,244 followers

๐Ÿš€ ๐—”๐—ฝ๐—ฟ๐—ถ๐—ฒ๐—น-๐Ÿญ.๐Ÿฑ-๐Ÿญ๐Ÿฑ๐—•-๐—ง๐—ต๐—ถ๐—ป๐—ธ๐—ฒ๐—ฟ โ€” ๐—ฆ๐—บ๐—ฎ๐—น๐—น model. ๐—•๐—ถ๐—ด reasoning ๐Ÿ”ฅ Introducing ServiceNowโ€™s 15B-parameter model that matches ๐——๐—ฒ๐—ฒ๐—ฝ๐—ฆ๐—ฒ๐—ฒ๐—ธโ€“๐—ฅ๐Ÿญโ€“๐Ÿฌ๐Ÿฑ๐Ÿฎ๐Ÿด, ๐— ๐—ถ๐˜€๐˜๐—ฟ๐—ฎ๐—นโ€“๐—บ๐—ฒ๐—ฑ๐—ถ๐˜‚๐—บโ€“๐Ÿญ.๐Ÿฎ and ๐—š๐—ฒ๐—บ๐—ถ๐—ป๐—ถ ๐—™๐—น๐—ฎ๐˜€๐—ต ๐Ÿฎ.๐Ÿฑ on the Artificial Analysis Index (๐—”๐—”๐—œ ๐Ÿฑ๐Ÿฎ) โ€” delivering comparable results at a ๐—ณ๐—ฟ๐—ฎ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐˜€๐—ถ๐˜‡๐—ฒ (at least 8-10 times smaller) >> Why it matters ๐Ÿ’ก โšก ๐—™๐—ฟ๐—ผ๐—ป๐˜๐—ถ๐—ฒ๐—ฟ-๐—น๐—ฒ๐˜ƒ๐—ฒ๐—น ๐—ฟ๐—ฒ๐—ฎ๐˜€๐—ผ๐—ป๐—ถ๐—ป๐—ด on a single GPU ๐Ÿง  ๐—ก๐—ผ ๐—ฅ๐—Ÿ ๐—ฝ๐—ต๐—ฎ๐˜€๐—ฒ โ€” the step-change comes from mid-training ๐Ÿ’ฌ ๐—ฅ๐—ฒ๐—ฎ๐˜€๐—ผ๐—ป๐˜€ ๐—ผ๐˜ƒ๐—ฒ๐—ฟ ๐—ถ๐—บ๐—ฎ๐—ด๐—ฒ๐˜€ -ย Image + Text mid training enables model to reason over images without additional training ๐Ÿงฉ ๐—š๐—ฟ๐—ฒ๐—ฎ๐˜ ๐—ฎ๐˜ ๐—ฟ๐—ฒ๐—ฎ๐˜€๐—ผ๐—ป๐—ถ๐—ป๐—ด โ€” AIME2025: 88, GPQA: 71, LCB: 73 โœ… ๐—™๐—ผ๐—น๐—น๐—ผ๐˜„๐˜€ ๐—ถ๐—ป๐˜€๐˜๐—ฟ๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป๐˜€ reliably โ€” IFBench: 62 ๐Ÿ“ก T๐—ฎ๐˜‚๐Ÿฎ ๐—•๐—ฒ๐—ป๐—ฐ๐—ต (Telecom): 68 โ†’ ready for real-world workflows ๐Ÿ“ฆ ๐—ข๐—ฝ๐—ฒ๐—ป ๐˜„๐—ฒ๐—ถ๐—ด๐—ต๐˜๐˜€ model to further research and reproducibility (MIT license) >> Try it / get it ๐Ÿ”— ๐Ÿง  Model weights: https://lnkd.in/exmZC4J6 ๐Ÿ’ฌ Chat demo (HF Space): https://lnkd.in/eC_vx8zr ~25% of Apriel-v1.5's pre-training text data for depth up-scaling comes from NVIDIA Nemotron collection. Shoutout to NVIDIA AI for their amazing open source work. Thanks to the NVIDIA DGX Cloud team for helping debug the cluster 24*7 ๐Ÿ”ฅ Grateful as well to our amazing collaborators from Turing, who helped craft the highest quality human data! Shruthan Radhakrishna, Jash Mehta, Aman Tiwari, Pulkit Pattnaik, Saloni Mittal, Kelechi O., Akintunde O., Masoud Hashemi, Rishabh Maheshwary, Shiva Krishna Reddy Malay, Aanjaneya Shukla, Oluwanifemi Bamgbose, Sathwik Tejaswi Madhusudan, Torsten Scholak, Sagar Davasam, Srinivas Sunkara, Nicolas Chapados, Raahul Srinivasan, Khalil Slimi #AI #GenAI #LLM #Huggingface #Multimodal #SOTA #ServiceNow #Reasoning #NVIDIA #DGX #OpenWeights

Post contentPost content