Inference Logoinference.sh

CLI Setup

Install the command-line tool for creating apps.


Prerequisites

For Python Apps: uv

The CLI uses uv for Python environment management:

bash
1curl -LsSf https://astral.sh/uv/install.sh | sh23# Windows4powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"

For Node.js Apps: Node.js

Node.js v20 or later:

bash
1# macOS / Linux (via fnm)2curl -fsSL https://fnm.vercel.app/install | bash3fnm install 2245# Or via nvm6curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.0/install.sh | bash7nvm install 22

Hardware

App TypeDevelopment Environment
CPU appsAny machine
GPU appsRequires NVIDIA CUDA GPU

Install CLI

bash
1curl -fsSL https://cli.inference.sh | sh

Verify

bash
1infsh version

Login

bash
1infsh login

Opens a browser to authenticate.


Check your account

bash
1infsh me

Shows your username and team.


What you can do

Development

CommandPurpose
infsh app initCreate a new app
infsh app testTest locally
infsh app deployDeploy to inference.sh

Running Apps

CommandPurpose
infsh app runRun an app in the cloud
infsh app sampleGenerate sample input

Managing Apps

CommandPurpose
infsh app myList your deployed apps
infsh app listBrowse available apps
infsh app searchSearch apps by name or description
infsh app getGet app details
infsh app pullDownload an app

Secrets

CommandPurpose
infsh secrets listList all secrets
infsh secrets set <key> <value>Create or update a secret
infsh secrets get <key>Get a secret (masked)
infsh secrets delete <key>Delete a secret

Environment Variables

VariableDescription
INFSH_API_KEYAPI key (overrides config file)

Shell Completions

bash
1infsh completion bash  # or zsh, fish, powershell

Next

Coding Agents — Build with AI assistants

Creating an App — Manual setup

we use cookies

we use cookies to ensure you get the best experience on our website. for more information on how we use cookies, please see our cookie policy.

by clicking "accept", you agree to our use of cookies.
learn more.