| Title: |
NVIDIA Nemotron 3: Efficient and Open Intelligence |
| Authors: |
NVIDIA; Blakeman, Aaron; Grattafiori, Aaron; Basant, Aarti; Gupta, Abhibha; Khattar, Abhinav; Renduchintala, Adi; Vavre, Aditya; Shukla, Akanksha; Bercovich, Akhiad; Ficek, Aleksander; Shaposhnikov, Aleksandr; Kondratenko, Alex; Bukharin, Alexander; Milesi, Alexandre; Taghibakhshi, Ali; Liu, Alisa; Barton, Amelia; Mahabaleshwarkar, Ameya Sunil; Klein, Amir; Zuker, Amit; Geifman, Amnon; Shen, Amy; Bhiwandiwalla, Anahita; Tao, Andrew; Agrusa, Anjulie; Verma, Ankur; Guan, Ann; Mandarwal, Anubhav; Mehta, Arham; Aithal, Ashwath; Poojary, Ashwin; Ahamed, Asif; Mishra, Asit; Thekkumpate, Asma Kuriparambil; Dattagupta, Ayush; Zhu, Banghua; Sadeghi, Bardiya; Simkin, Barnaby; Lanir, Ben; Schifferer, Benedikt; Nushi, Besmira; Kartal, Bilal; Rouhani, Bita Darvish; Ginsburg, Boris; Norick, Brandon; Soubasis, Brandon; Kisacanin, Branislav; Yu, Brian; Catanzaro, Bryan; del Mundo, Carlo; Hwang, Chantal; Wang, Charles; Hsieh, Cheng-Ping; Zhang, Chenghao; Yu, Chenhan; Mungekar, Chetan; Patel, Chintan; Alexiuk, Chris; Parisien, Christopher; Neale, Collin; Meurillon, Cyril; Mosk-Aoyama, Damon; Su, Dan; Corneil, Dane; Afrimi, Daniel; Lo, Daniel; Rohrer, Daniel; Serebrenik, Daniel; Gitman, Daria; Levy, Daria; Stosic, Darko; Mosallanezhad, David; Narayanan, Deepak; Nathawani, Dhruv; Rekesh, Dima; Yared, Dina; Kakwani, Divyanshu; Ahn, Dong; Riach, Duncan; Stosic, Dusan; Minasyan, Edgar; Lin, Edward; Long, Eileen; Long, Eileen Peters; Segal, Elad; Lantz, Elena; Evans, Ellie; Ning, Elliott; Chung, Eric; Harper, Eric; Tramel, Eric; Galinkin, Erick; Pounds, Erik; Briones, Evan; Bakhturina, Evelina; Tsykunov, Evgeny; Ladhak, Faisal; Wang, Fay; Jia, Fei; Soares, Felipe; Chen, Feng; Galko, Ferenc; Sun, Frank; Siino, Frankie; Agam, Gal Hubara; Ajjanagadde, Ganesh; Bhatt, Gantavya; Prasad, Gargi; Armstrong, George; Shen, Gerald; Batmaz, Gorkem; Nalbandyan, Grigor; Qian, Haifeng; Sharma, Harsh; Ross, Hayley; Ngo, Helen; Hum, Herbert; Sahota, Herman; Wang, Hexin; Soni, Himanshu; Upadhyay, Hiren; Mao, Huizi; Nguyen, Huy C; Nguyen, Huy Q; Cunningham, Iain; Galil, Ido; Shahaf, Ido; Gitman, Igor; Loshchilov, Ilya; Schen, Itamar; Levy, Itay; Moshkov, Ivan; Golan, Izik; Putterman, Izzy; Kautz, Jan; Scowcroft, Jane Polak; Casper, Jared; Mitra, Jatin; Glick, Jeffrey; Chen, Jenny; Oliver, Jesse; Zhang, Jian; Zeng, Jiaqi; Lou, Jie; Zhang, Jimmy; Choi, Jinhang; Huang, Jining; Conway, Joey; Guman, Joey; Kamalu, John; Greco, Johnny; Cohen, Jonathan; Jennings, Joseph; Daw, Joyjit; Vialard, Julien Veron; Yi, Junkeun; Parmar, Jupinder; Xu, Kai; Zhu, Kan; Briski, Kari; Cheung, Katherine; Luna, Katherine; Wyss, Keith; Santhanam, Keshav; Shih, Kevin; Kong, Kezhi; Bhardwaj, Khushi; Shankar, Kirthi; Puvvada, Krishna C.; Pawelec, Krzysztof; Anik, Kumar; McAfee, Lawrence; Sleiman, Laya; Derczynski, Leon; Ding, Li; Wei, Lizzie; Liebenwein, Lucas; Vega, Luis; Grover, Maanu; Van Segbroeck, Maarten; de Melo, Maer Rodrigues; Nazemi, Mahdi; Sreedhar, Makesh Narsimhan; Kilaru, Manoj; Ashkenazi, Maor; Romeijn, Marc; Chochowski, Marcin; Cai, Mark; Kliegl, Markus; Moosaei, Maryam; Kulka, Matt; Novikov, Matvei; Samadi, Mehrzad; Corpuz, Melissa; Wang, Mengru; Price, Meredith; Andersch, Michael; Boone, Michael; Evans, Michael; Martinez, Miguel; Khona, Mikail; Chrzanowski, Mike; Lee, Minseok; Dabbah, Mohammad; Shoeybi, Mohammad; Patwary, Mostofa; Mulepati, Nabin; Nabwani, Najeeb; Hereth, Natalie; Assaf, Nave; Habibi, Negar; Zmora, Neta; Haber, Netanel; Sessions, Nicola; Bhatia, Nidhi; Jukar, Nikhil; Pope, Nikki; Ludwig, Nikolai; Tajbakhsh, Nima; Ailon, Nir; Juluru, Nirmal; Sharma, Nishant; Hrinchuk, Oleksii; Kuchaiev, Oleksii; Delalleau, Olivier; Olabiyi, Oluwatobi; Argov, Omer Ullman; Puny, Omri; Tropp, Oren; Xie, Ouye; Chadha, Parth; Shamis, Pasha; Gibbons, Paul; Molchanov, Pavlo; Morkisz, Pawel; Dykas, Peter; Jin, Peter; Xu, Pinky; Januszewski, Piotr; Thombre, Pranav Prashant; Varshney, Prasoon; Gundecha, Pritam; Tredak, Przemek; Miao, Qing; Wan, Qiyu; Mahabadi, Rabeeh Karimi; Garg, Rachit; El-Yaniv, Ran; Zilberstein, Ran; Shafipour, Rasoul; Harang, Rich; Izzo, Rick; Shahbazyan, Rima; Garg, Rishabh; Borkar, Ritika; Gala, Ritu; Islam, Riyad; Hesse, Robert; Waleffe, Roger; Watve, Rohit; Koren, Roi; Zhang, Ruoxi; Hewett, Russell; Hewett, Russell J.; Prenger, Ryan; Timbrook, Ryan; Mahdavi, Sadegh; Modi, Sahil; Kriman, Samuel; Lim, Sangkug; Kariyappa, Sanjay; Satheesh, Sanjeev; Kaji, Saori; Pasumarthi, Satish; Muralidharan, Saurav; Narentharen, Sean; Narenthiran, Sean; Bak, Seonmyeong; Kashirsky, Sergey; Poulos, Seth; Mor, Shahar; Ramasamy, Shanmugam; Acharya, Shantanu; Ghosh, Shaona; Sreenivas, Sharath Turuvekere; Thomas, Shelby; Fan, Shiqing; Gopal, Shreya; Prabhumoye, Shrimai; Pachori, Shubham; Toshniwal, Shubham; Ding, Shuoyang; Singh, Siddharth; Sun, Simeng; Ithape, Smita; Majumdar, Somshubra; Singhal, Soumye; Sergienko, Stas; Alborghetti, Stefania; Ge, Stephen; Devare, Sugam Dipak; Barua, Sumeet Kumar; Panguluri, Suseella; Gupta, Suyog; Priyadarshi, Sweta; Akter, Syeda Nahida; Bui, Tan; Ene, Teodor-Dumitru; Kong, Terry; Do, Thanh; Blankevoort, Tijmen; Moon, Tim; Balough, Tom; Asida, Tomer; Natan, Tomer Bar; Ronen, Tomer; Konuk, Tugrul; Vashishth, Twinkle; Karpas, Udi; De, Ushnish; Noorozi, Vahid; Noroozi, Vahid; Srinivasan, Venkat; Elango, Venmugil; Cui, Victor; Korthikanti, Vijay; Rao, Vinay; Kurin, Vitaly; Lavrukhin, Vitaly; Anisimov, Vladimir; Jiang, Wanli; Ahmad, Wasi Uddin; Du, Wei; Ping, Wei; Zhou, Wenfei; Jennings, Will; Zhang, William; Prazuch, Wojciech; Ren, Xiaowei; Karnati, Yashaswi; Choi, Yejin; Meyer, Yev; Wu, Yi-Fu; Zhang, Yian; Qin, Yigong; Lin, Ying; Geifman, Yonatan; Fu, Yonggan; Subara, Yoshi; Suhara, Yoshi; Gao, Yubo; Moshe, Zach; Dong, Zhen; Zhu, Zhongbo; Liu, Zihan; Chen, Zijia; Yan, Zijie |
| Publication Year: |
2025 |
| Collection: |
ArXiv.org (Cornell University Library) |
| Subject Terms: |
Computation and Language; Artificial Intelligence; Machine Learning |
| Description: |
We introduce the Nemotron 3 family of models - Nano, Super, and Ultra. These models deliver strong agentic, reasoning, and conversational capabilities. The Nemotron 3 family uses a Mixture-of-Experts hybrid Mamba-Transformer architecture to provide best-in-class throughput and context lengths of up to 1M tokens. Super and Ultra models are trained with NVFP4 and incorporate LatentMoE, a novel approach that improves model quality. The two larger models also include MTP layers for faster text generation. All Nemotron 3 models are post-trained using multi-environment reinforcement learning enabling reasoning, multi-step tool use, and support granular reasoning budget control. Nano, the smallest model, outperforms comparable models in accuracy while remaining extremely cost-efficient for inference. Super is optimized for collaborative agents and high-volume workloads such as IT ticket automation. Ultra, the largest model, provides state-of-the-art accuracy and reasoning performance. Nano is released together with its technical report and this white paper, while Super and Ultra will follow in the coming months. We will openly release the model weights, pre- and post-training software, recipes, and all data for which we hold redistribution rights. |
| Document Type: |
text |
| Language: |
unknown |
| Relation: |
http://arxiv.org/abs/2512.20856 |
| Availability: |
http://arxiv.org/abs/2512.20856 |
| Accession Number: |
edsbas.26210AAA |
| Database: |
BASE |