🗑️ Remove local-api-test project files and add new untracked directory local-ai-test/

This commit is contained in:
2026-04-19 11:27:46 +08:00
parent 4de35240f3
commit 989bb3d55e
5 changed files with 0 additions and 0 deletions

View File

@@ -0,0 +1,29 @@
# local-ai-test
## How to run?
Export environments then run:
```shell
uv run main.py
```
Run with `tiny-encrypt` environments:
```shell
tiny-encrypt -X -k $(cat ~/.config/envs/LCOAL_DEFAULT_TINY_ENCRYPT_KEY_ID) \
~/secrets/alibaba-cloud-ai-cn.env.tinyenc -- go run main.go
```
Use local llm-proxy:
```shell
OPENAI_API_BASE=http://127.0.0.1:8080/ python main.py
OPENAI_API_BASE=http://127.0.0.1:8080/ python main-stream.py
```
## Reference
- https://help.aliyun.com/zh/model-studio/stream - 大模型服务平台百炼 / 文本生成 / 流式输出