hatter/py-scripts

Files

History

Hatter Jiang 4de35240f3

📝 Update README with detailed instructions and references for local API testing

2026-04-19 11:26:36 +08:00

..

justfile

📝 Update README with detailed instructions and references for local API testing

2026-04-19 11:26:36 +08:00

main-stream.py

📝 Update README with detailed instructions and references for local API testing

2026-04-19 11:26:36 +08:00

main.py

🔄 Update chat completion logic and improve debugging output in main.py

2026-04-19 10:16:47 +08:00

pyproject.toml

📦 Update project dependencies and configuration files

2026-04-19 09:52:54 +08:00

README.md

📝 Update README with detailed instructions and references for local API testing

2026-04-19 11:26:36 +08:00

README.md

local-ai-test

How to run?

Export environments then run:

uv run main.py

Run with tiny-encrypt environments:

tiny-encrypt -X -k $(cat ~/.config/envs/LCOAL_DEFAULT_TINY_ENCRYPT_KEY_ID) \
   ~/secrets/alibaba-cloud-ai-cn.env.tinyenc -- go run main.go

Use local llm-proxy:

OPENAI_API_BASE=http://127.0.0.1:8080/ python main.py

OPENAI_API_BASE=http://127.0.0.1:8080/ python main-stream.py

Reference

https://help.aliyun.com/zh/model-studio/stream - 大模型服务平台百炼 / 文本生成 / 流式输出