All Posts

2.6 animations

07 . 25 . 2023

Ray 2.6 features streaming for Serve and Train and new Multi-GPU Learner API

By Jules S. Damji and 
Richard Liaw
Anyscale Snowflake Connector Main

07 . 20 . 2023

Introducing the Anyscale Snowflake Connector

By Eric Greene
fine-tune-img-1

07 . 05 . 2023

Fine tuning is for form, not facts

By Waleed Kadous and 
Kourosh Hakhamaneshi
llamaindex-img-3

06 . 26 . 2023

Build and Scale a Powerful Query Engine with LlamaIndex and Ray

By Jerry Liu and 
Amog Kamsetty
rllib_figure_5

06 . 26 . 2023

Introducing RLlib Multi-GPU Stack for Cost Efficient, Scalable, Multi-GPU RL Agents Training

By Avnish Narayan and 
Kourosh Hakhamaneshi
Cover image for 23X batch blog

06 . 22 . 2023

How continuous batching enables 23x throughput in LLM inference while reducing p50 latency

By Cade Daniel, 
Chen Shen, 
Eric Liang and 
Richard Liaw
0 -Anyscale Databricks headline image

06 . 15 . 2023

Introducing the Anyscale Databricks Connector

By Eric Greene
Ray_2.5_main_image

06 . 13 . 2023

Ray 2.5 features training and serving for LLMs, Multi-GPU training in RLlib, and enhanced Ray Data support

By Richard Liaw and 
Jules S. Damji
Aviary Explorer

05 . 31 . 2023

Announcing Aviary: Open Source Multi-LLM Serving

By Waleed Kadous
Sewer inspection graphic

05 . 22 . 2023

Inspecting Sewer Line Safety Using Thousands of Hours of Video

By Lance Walter
numbers-cover-image

05 . 17 . 2023

Numbers every LLM Developer should know

By Waleed Kadous
batch_inference_fig_1

05 . 16 . 2023

Scaling Model Batch Inference in Ray: Using Actors, ActorPool, and Ray Data

By Eric Liang, Jules S. Damji, Zhe Zhang
main_streaming_image

05 . 11 . 2023

Streaming distributed execution across CPUs and GPUs

By Eric Liang, 
Stephanie Wang and 
Cheng Su
Ray_summit_2023_main_image

05 . 10 . 2023

10 must-attend Ray Summit sessions: Generative AI, scalable ML workloads, and more

By Jules S. Damji and 
Ben Lorica
qna-answering-questions-with

05 . 08 . 2023

Building a Self Hosted Question Answering Service using LangChain + Ray in 20 minutes

By Waleed Kadous
Figure 1

05 . 04 . 2023

Offline Batch Inference: Comparing Ray, Apache Spark, and SageMaker

By Amog Kamsetty, 
Eric Liang and 
Jules S. Damji
Embedding - Stages of our Data Pipeline

05 . 03 . 2023

Turbocharge LangChain: guide to 20x faster embedding

By Amog Kamsetty and 
Philipp Moritz
Lance Walter Headshot

04 . 28 . 2023

Why I Joined Anyscale: Powering an Open Source AI Revolution

By Lance Walter