What is Inference Data?
inference The inference pipeline is an efficient method for processing static video files and streams Select a model, define the video source, and set a callback action
Figure 1: The Ladder of Inference · Experience these selectively based on our beliefs and prior experience · Interpret what they mean · Apply our existing inference Replace OpenAI GPT with another LLM in your app by changing a single line of code Xinference gives you the freedom to use any LLM you need With Xinference
inference The inference pipeline is an efficient method for processing static video files and streams Select a model, define the video source, and set a callback action
inference Figure 1: The Ladder of Inference · Experience these selectively based on our beliefs and prior experience · Interpret what they mean · Apply our existing
Replace OpenAI GPT with another LLM in your app by changing a single line of code Xinference gives you the freedom to use any LLM you need With Xinference