Lemonade How to use amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid
Run and chat with the model (requires XDNA 2 NPU)
lemonade run user.Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid
List all available models
lemonade list
