Pre-training
- Domain learning at scale: Train on large volumes of unstructured enterprise data to internalize your domain language and concepts.
- Model architectures: Support for advanced architectures including Dense and Mixture-of-Experts (MoE) to balance performance, specialization, and efficiency for enterprise-scale workloads.
- Multi-modal ready foundations: Text, image and audio support where relevant.