===== LLM on Edge2 =====

To quickly run large language models (LLMs) on your Khadas Edge2 (RK3588S) device, simply run the following script:

<code bash>
khadas_llm.sh
</code>

This script will:

  * Install necessary dependencies such as ''cmake''
  * Prompt you to choose from the following supported models:
    - DeepSeek 1.5B
    - DeepSeek 7B
    - Qwen2 2B-VL
    - ChatGLM3 6B
  * Automatically clone the required repositories
  * Download the selected RKLLM model
  * Compile the demo
  * Configure tokens and context length
  * Launch the inference demo optimized for Edge2 NPU

No manual setup required — just run the script and follow the prompts!