inference.sh
open sourceshadcn/ui compatible

the foundation for
ai chat interfaces

a set of beautifully designed components for building ai-powered chat applications. copy and paste into your apps. open source. open code.

get startedgithub
npx shadcn@latest add https://ui.inference.sh/r/agent.json
streaming
tool support
widgets
type safe
open source
themeable

examples

interactive demos showcasing the widget renderer.

departure

SFO

san francisco
✈️

5h 45m

on time

arrival

JFK

new york

san francisco

partly cloudy

68°

⛅

H: 72° L: 58°

showcase

widget examples powered by declarative json.

AAPL

$178.72

+2.4%

apple inc. • nasdaq

album
blinding lights

the weeknd

focus time

24:59

✓

payment sent

$250.00

components

everything you need to build ai-powered chat interfaces.

featured

agent chat

full-featured agent chat with streaming, tools, and widgets.

view component

chat ui

building blocks: container, messages, input, and indicators.

view component

markdown

rich markdown with syntax highlighting and embeds.

view component

widgets

declarative ui from json - forms, buttons, cards.

view component

tool ui

tool lifecycle: pending, progress, approval, results.

view component

task output

real-time task display with streaming support.

view component

quick start

get up and running in minutes.

1

install the agent component

bash
1npx shadcn@latest add https://ui.inference.sh/r/agent.json
2

add the api proxy route

typescript
1// app/api/inference/proxy/route.ts2import { route } from '@inferencesh/sdk/proxy/nextjs';3export const { GET, POST, PUT } = route;
3

set your api key

bash
1INFERENCE_API_KEY=inf_...
4

use the component

tsx
1<Agent2  proxyUrl="/api/inference/proxy"3  agentConfig={{4    core_app: { ref: 'openrouter/claude-haiku-45@0fkg6xwb' },5    description: 'a helpful ai assistant',6    system_prompt: 'you are helpful.',7  }}8/>