Tabby [1][2]ΒΆ

.\tabby.exe serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct
.\tabby.exe serve --model Qwen2.5-Coder-7B --chat-model CodeQwen-7B-Chat --device cuda

  1. Visit http://localhost:8080 and login.

  2. User β†’ Token β†’ Copy this.

SettingΒΆ

  1. Vscodium β†’ Plugins β†’ Search β†’ Tabby β†’ Install

  2. Tabby β†’ Connect to Server β†’ http://localhost:8080 β†’ Enter token