Solar Pro Preview Unveiled

Upstage has unveiled a preview of Solar Pro, its next-generation LLM. It is offered as an open-source model with free API access support, allowing developers and enterprises to test and provide feedback before the official launch in November.

Solar Pro is the flagship model of the Solar LLM series, featuring 22 billion parameters. While more than twice the size of its predecessor Solar Mini, it has been optimized to run efficiently on a single GPU through Upstage's Depth-Up Scaling (DUS) method and an advanced data recipe.

The performance improvements are notable.

• Average performance across major LLM benchmarks improved by 51% over Solar Mini.
• It scored 52.11 on MMLU Pro, demonstrating language understanding and reasoning across 14 domains.
• It scored 84.37 on IFEval, proving its ability to follow complex instructions.
• It outperformed comparable models such as Phi 3 Medium, Llama 3.1 8B, Mistral NeMo 12B, and Gemma 2 27B, and competes with much larger models like Llama 3.1 70B.

Upstage explained that Solar Pro can automate a variety of enterprise workflows, including in healthcare, finance, and legal work, and can be used for patient record analysis, clinical summarization, financial analysis, report writing, contract review, and legal research. The preview version supports English input and offers a 4,096 tokens context window, and commercial use is also available prior to the official launch.