Note: Fork and clone this repository if needed

python3 -m venv ~/.venvs/aienv
source ~/.venvs/aienv/bin/activate

export SAMBANOVA_API_KEY=***

pip install -U openai phidata

• Streaming on

python cookbook/providers/sambanova/basic_stream.py

• Streaming off

python cookbook/providers/sambanova/basic.py

Sambanova does not support all OpenAI features. The following features are not yet supported and will be ignored:

• logprobs
• top_logprobs
• n
• presence_penalty
• frequency_penalty
• logit_bias
• tools
• tool_choice
• parallel_tool_calls
• seed
• stream_options: include_usage
• response_format

Author : Stanley Ekene Uzum