This engine is designed to be used in the AWE Network and is built on top of the SGLang framework.

Use python -m pip install -e . to install the package. (We gonna release it to pypi soon)

• Provide an easy to use environment for LLM agents like OpenAI Gym for RL agents.
• Achieve higher performance by unlocking more parallelism, load balancing and better cache hit rate.