Solar Pro launches on AWS

Upstage has launched its next-generation LLM Solar Pro on AWS. The model is available through Amazon Bedrock Marketplace, Amazon SageMaker JumpStart, and AWS Marketplace, and can be customized and fine-tuned for various industries such as healthcare, finance, and legal.

Solar Pro has 22B parameters, larger than its previous 10.7B model, Solar Mini, and the company stated it showed a 50% performance improvement on key benchmarks. In the September preview, it achieved top results in the under-70B category of the HuggingFace Open LLM Leaderboard, the EQ Bench Leaderboard, and the Predibase Fine-Tuning Leaderboard.

Training was conducted on Amazon SageMaker, and advanced data pre-processing along with continued pre-training significantly reduced training time. The training data drew on data from the 1 Trillion Token Club, led by Upstage, including copyright-free English and Korean text, books, news, and reports, with a focus on improving cultural context understanding and response accuracy while reducing hallucination.

The core technology is Upstage's Depth-Up Scaling (DUS).

• Compresses the model for single-GPU deployment while maintaining performance
• The company explained that without it, achieving the same results would have required a model nearly 4 times larger
• Designed to enable use of generative AI without major infrastructure upgrades

On the deployment side, users can choose from over 100 models on Amazon Bedrock Marketplace, and leverage tools like Guardrails and Agents, security and privacy features, and fully managed endpoints. Beyond processing healthcare, finance, and legal documents, it was also highlighted for use in understanding multi-page documents such as invoices, contracts, and regulatory filings and extracting them into structured information.

Adoption cases were also presented. MFDS developed an LLM chatbot trained on internal manuals for public use, handling inquiries about cosmetics regulations in real time, and Sendbird has integrated Solar into its no-code generative AI chatbot solution to support building customer support chatbots for web and mobile apps. The company added that global companies such as Intel, Poe by Quora, you.com, and Sendbird are using Solar Pro.