groq-ai-toolkit

Python

Python wrapper and CLI for Groq LPU.

A lightweight Python API wrapper and CLI for Groq's LPU Inference Engine. Achieve near-real-time responses at 800 tokens/sec. Supports chatbots and text generation with simple commands.

python groq ai cli

View on GitHub Get Started

[features]

Ultra-Fast

800 tokens/sec with LPU engine

Conversational AI

Interactive chatbots and assistants

Text Generation

Contextually relevant responses

Lightweight

Minimal dependencies

[install]

git clone https://github.com/RMNCLDYO/groq-ai-toolkit.git
cd groq-ai-toolkit
pip install -r requirements.txt

[usage]

# CLI
python cli.py --chat
python cli.py --text --prompt "Write a story"

# Python
from groq import Chat, Text
Chat().run()
Text().run(prompt="Write a story")

[requirements]

Python 3.x
Groq API key

[license]

This project is licensed under the MIT license.

[links]

GitHub Repository