Agent Tools

inference.sh

Run 150+ AI apps in the cloud with a simple CLI. No GPU required.


Install CLI

curl -fsSL https://cli.inference.sh | sh
infsh login

What does the installer do? The install script detects your OS and architecture, downloads the correct binary from dist.inference.sh, verifies its SHA-256 checksum, and places it in your PATH. That's it — no elevated permissions, no background processes, no telemetry. If you have cosign installed, the installer also verifies the Sigstore signature automatically.

>

Manual install (if you prefer not to pipe to sh):

```bash

# Download the binary and checksums

curl -LO https://dist.inference.sh/cli/checksums.txt

curl -LO $(curl -fsSL https://dist.inference.sh/cli/manifest.json | grep -o '"url":"[^"]*"' | grep $(uname -s | tr A-Z a-z)-$(uname -m | sed 's/x86_64/amd64/;s/aarch64/arm64/') | head -1 | cut -d'"' -f4)

# Verify checksum

sha256sum -c checksums.txt --ignore-missing

# Extract and install

tar -xzf inferencesh-cli-*.tar.gz

mv inferencesh-cli-* ~/.local/bin/inferencesh

```

Quick Examples

# Generate an image
infsh app run falai/flux-dev-lora --input '{"prompt": "a cat astronaut"}'

# Generate a video
infsh app run google/veo-3-1-fast --input '{"prompt": "drone over mountains"}'

# Call Claude
infsh app run openrouter/claude-sonnet-45 --input '{"prompt": "Explain quantum computing"}'

# Web search
infsh app run tavily/search-assistant --input '{"query": "latest AI news"}'

# Post to Twitter
infsh app run x/post-tweet --input '{"text": "Hello from AI!"}'

# Generate 3D model
infsh app run infsh/rodin-3d-generator --input '{"prompt": "a wooden chair"}'

Commands

What's Available

Related Skills

# Image generation (FLUX, Gemini, Grok, Seedream)
npx skills add inference-sh/skills@ai-image-generation

# Video generation (Veo, Seedance, Wan, OmniHuman)
npx skills add inference-sh/skills@ai-video-generation

# LLMs (Claude, Gemini, Kimi, GLM via OpenRouter)
npx skills add inference-sh/skills@llm-models

# Web search (Tavily, Exa)
npx skills add inference-sh/skills@web-search

# AI avatars & lipsync (OmniHuman, Fabric, PixVerse)
npx skills add inference-sh/skills@ai-avatar-video

# Twitter/X automation
npx skills add inference-sh/skills@twitter-automation

# Model-specific
npx skills add inference-sh/skills@flux-image
npx skills add inference-sh/skills@google-veo

# Utilities
npx skills add inference-sh/skills@image-upscaling
npx skills add inference-sh/skills@background-removal

Reference Files

• Authentication & Setup
• Discovering Apps
• Running Apps
• CLI Reference

Documentation

• Agent Skills Overview - The open standard for AI capabilities
• Getting Started - Introduction to inference.sh
• What is inference.sh? - Platform overview
• Apps Overview - Understanding the app ecosystem
• CLI Setup - Installing the CLI
• Workflows vs Agents - When to use each
• Why Agent Runtimes Matter - Runtime benefits

Discovering Apps

List All Apps

infsh app list

Pagination

infsh app list --page 2

Filter by Category

infsh app list --category image
infsh app list --category video
infsh app list --category audio
infsh app list --category text
infsh app list --category other

Search

infsh app search "flux"
infsh app search "video generation"
infsh app search "tts" -l
infsh app search "image" --category image

Or use the flag form:

infsh app list --search "flux"
infsh app list --search "video generation"
infsh app list --search "tts"

Featured Apps

infsh app list --featured

Newest First

infsh app list --new

Detailed View

infsh app list -l

Shows table with app name, category, description, and featured status.

Save to File

infsh app list --save apps.json

Your Apps

List apps you've deployed:

infsh app my
infsh app my -l  # detailed

Get App Details

infsh app get falai/flux-dev-lora
infsh app get falai/flux-dev-lora --json

Shows full app info including input/output schema.

Popular Apps by Category

Image Generation

• falai/flux-dev-lora - FLUX.2 Dev (high quality)
• falai/flux-2-klein-lora - FLUX.2 Klein (fastest)
• infsh/sdxl - Stable Diffusion XL
• google/gemini-3-pro-image-preview - Gemini 3 Pro
• xai/grok-imagine-image - Grok image generation

Video Generation

• google/veo-3-1-fast - Veo 3.1 Fast
• google/veo-3 - Veo 3
• bytedance/seedance-1-5-pro - Seedance 1.5 Pro
• infsh/ltx-video-2 - LTX Video 2 (with audio)
• bytedance/omnihuman-1-5 - OmniHuman avatar

Audio

• infsh/dia-tts - Conversational TTS
• infsh/kokoro-tts - Kokoro TTS
• infsh/fast-whisper-large-v3 - Fast transcription
• infsh/diffrythm - Music generation

Documentation

• Browsing the Grid - Visual app browsing
• Apps Overview - Understanding apps
• Running Apps - How to run apps

Authentication & Setup

Install the CLI

curl -fsSL https://cli.inference.sh | sh

Login

infsh login

This opens a browser for authentication. After login, credentials are stored locally.

Check Authentication

infsh me

Shows your user info if authenticated.

Environment Variable

For CI/CD or scripts, set your API key:

export INFSH_API_KEY=your-api-key

The environment variable overrides the config file.

Update CLI

infsh update

Or reinstall:

curl -fsSL https://cli.inference.sh | sh

Troubleshooting

Documentation

• CLI Setup - Complete CLI installation guide
• API Authentication - API key management
• Secrets - Managing credentials

CLI Reference

Installation

curl -fsSL https://cli.inference.sh | sh

Global Commands

App Commands

Discovery

Execution

Task Commands

Development

Environment Variables

Shell Completions

# Bash
infsh completion bash > /etc/bash_completion.d/infsh

# Zsh
infsh completion zsh > "${fpath[1]}/_infsh"

# Fish
infsh completion fish > ~/.config/fish/completions/infsh.fish

App Name Format

Apps use the format namespace/app-name:

• falai/flux-dev-lora - fal.ai's FLUX 2 Dev
• google/veo-3 - Google's Veo 3
• infsh/sdxl - inference.sh's SDXL
• bytedance/seedance-1-5-pro - ByteDance's Seedance
• xai/grok-imagine-image - xAI's Grok

Version pinning: namespace/app-name@version

Documentation

• CLI Setup - Complete CLI installation guide
• Running Apps - How to run apps via CLI
• Creating an App - Build your own apps
• Deploying - Deploy apps to the cloud

Running Apps

Basic Run

infsh app run user/app-name --input input.json

Inline JSON

infsh app run falai/flux-dev-lora --input '{"prompt": "a sunset over mountains"}'

Version Pinning

infsh app run user/app-name@1.0.0 --input input.json

Generate Sample Input

Before running, generate a sample input file:

infsh app sample falai/flux-dev-lora

Save to file:

infsh app sample falai/flux-dev-lora --save input.json

Then edit input.json and run:

infsh app run falai/flux-dev-lora --input input.json

Workflow Example

Image Generation with FLUX

# 1. Get app details
infsh app get falai/flux-dev-lora

# 2. Generate sample input
infsh app sample falai/flux-dev-lora --save input.json

# 3. Edit input.json
# {
#   "prompt": "a cat astronaut floating in space",
#   "num_images": 1,
#   "image_size": "landscape_16_9"
# }

# 4. Run
infsh app run falai/flux-dev-lora --input input.json

Video Generation with Veo

# 1. Generate sample
infsh app sample google/veo-3-1-fast --save input.json

# 2. Edit prompt
# {
#   "prompt": "A drone shot flying over a forest at sunset"
# }

# 3. Run
infsh app run google/veo-3-1-fast --input input.json

Text-to-Speech

# Quick inline run
infsh app run infsh/kokoro-tts --input '{"text": "Hello, this is a test."}'

Task Tracking

When you run an app, the CLI shows the task ID:

Running falai/flux-dev-lora
Task ID: abc123def456

For long-running tasks, you can check status anytime:

# Check task status
infsh task get abc123def456

# Get result as JSON
infsh task get abc123def456 --json

# Save result to file
infsh task get abc123def456 --save result.json

Run Without Waiting

For very long tasks, run in background:

# Submit and return immediately
infsh app run google/veo-3 --input input.json --no-wait

# Check later
infsh task get <task-id>

Output

The CLI returns the app output directly. For file outputs (images, videos, audio), you'll receive URLs to download.

Example output:

{
  "images": [
    {
      "url": "https://cloud.inference.sh/...",
      "content_type": "image/png"
    }
  ]
}

Error Handling

Documentation

• Running Apps - Complete running apps guide
• Streaming Results - Real-time progress updates
• Setup Parameters - Configuring app inputs