Ray RLlib

Ray Train

Ray Datasets

RayDP

Retail

Gaming

Government

Financial

Ray Serve

Anyscale

Ray Core

Healthcare

Technology

News

User Story

Engineering

Culture

Goku Mohandas

Execute end-to-end LLM workflows to develop & productionize LLMs at scale.

End-to-end LLM Guide header

End-to-end LLM Workflows Guide

Sam Chan

image21

Cindy Zhang

image6

image9

Ray Spotlight Series: Multitenant Serve Applications with Runtime Envs as Containers

Marwan Sarieddine

Screenshot 2024-05-06 at 3.11.06 PM

Natalia Czerep

Mateusz Kwasniak

Artur Zygadło

Cross-modal-Search-for-E-commerce

Cross-modal Search for E-commerce: Building and Scaling a Cross-Modal Image Retrieval App

Max Pumperla

Max Pumperla headshot

Figure 1. End-to-end Stable Diffusion training architecture diagram.

End-to-end Stable Diffusion training architecture diagram

We Pre-Trained Stable Diffusion Models on 2 billion Images and Didn't Break the Bank - Definitive Guides with Ray Series

The Anyscale Team

Ray Meetup Logo

Easily Debug Ray Applications with Ray Distributed Debugger

stable-diffusion-processing-2-billion

Processing 2 Billion Images for Stable Diffusion Model Training - Definitive Guides with Ray Series

Yunxuan Xiao

771b7d9216ffb9c9f04e8521d896b37a

Hao Chen

In this blog post, we introduce an advanced pre-training solution for Stable Diffusion v2 models, leveraging the power of the Ray and Anyscale Platform to enhance scalability and cost efficiency.  

Scalable and Cost-Efficient Stable Diffusion Pre-training with Ray

Reducing the Cost of Pre-training Stable Diffusion by 3.7x with Anyscale

Ray Summit 2024, the annual Ray community conference, is back in San Francisco, CA this September 30th through October 2nd. It is a two-day event with a third day dedicated to training.

Call for Proposals is open Blog Post

Ray Summit 2024 Call for Proposals is now open

Ramit Hora

Intel and Anyscale have integrated Ray with Gaudi3. Gaudi3 is AI-optimized for efficient training and other machine learning workloads.

Anyscale - Intel

Accelerating AI: Harnessing Intel(R) Gaudi(R) 3 with Ray 2.10

Update on Ray CVE-2023-48022: New Verification Tooling Available

Neelay Shah

Akshay Malik

Anyscale is teaming with NVIDIA to combine the developer productivity of Ray Serve and RayLLM with the cutting-edge optimizations from NVIDIA Triton Inference Server software and the NVIDIA TensorRT-LLM library.

NVIDIA-Anyscale Logo 1280x680.jpg

Low-latency Generative AI Model Serving with Ray, NVIDIA Triton Inference Server, and NVIDIA TensorRT-LLM

Artur Niederfahrenhorst

Kourosh Hakhamaneshi

Based on the popular “Needle In a Haystack” benchmark and RAG, we share our process of creating a problem-specific fine-tuning dataset to extend the context of models to build better RAG systems.

fine tuning llms query featured

Fine-tuning LLMs for longer context and better RAG systems

Scott Lee

Kyle Huang

Cheng Su

Generating embeddings is a critical task for developing successful RAG applications, and Anyscalew with Pinecone is the most cost-efficient solution for this workflow.

blog-anyscale-pincone

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone

llm-api-leaderboard-compare

Comparing LLM performance: Introducing the Open Source Leaderboard for LLM APIs

Endpoints Team

Anyscale Endpoints is the first LLM APIs providing a wide range of capabilities to empower developers to build their applications not just from serving and fine tuning LLMs, but also leveraging embedding services and function calling.

anyscale-endpoints-llama-and-orca

Anyscale Endpoints: JSON Mode, Function calling, New models: Llama Guard and Mistral-7B-OpenOrca

Anyscale + Astronomer

Scalable Machine Learning with Anyscale and Astronomer

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

All Posts