LM Studio

usage

  • Discover → Select the LLM → Choose a download option → Check Full GPU Offload Possible → Download.
  • Chat → Select a model to load → Select the LLM.
  • Developer → Enable CORS (On) → Serve on Local Network (on) → Select a model to load → Start Server.

troubleshoot

1

  1. Install LM Studio.
  2. Go to C:\Users\User\AppData\Local\LM-Studio\app-*\resources\app\.webpack\main.
  3. Find in folder, replace huggingface.co to hf-mirror.com.