Skip to main content

Groq

Official website https://groq.com/

Groq provides us with a simple way to leverage models running on LPU (Language Processing Unit). This enables us to achieve incredibly fast inference response times.

Connect your Groq account​

  • Create an account in https://groq.com/
  • Go to your dashboard
  • Go to VSCode and choose Groq as Provider
  • Set connection on 🔑 button.
  • Paste API Key here, and click on Connect:
Remove Key

If you want to remove your API Key from CodeGPT, select Edit Connection on 🔑, and click on Disconnect

Groq models available in CodeGPT​

  • llama3-70b-8192
  • llama3-8b-8192
  • mixtral-8x7b-32768
  • gemma-7b-it
  • llama2-70b-4096