FlaskGitzella
basic llm wrapper cli flask
Basic LLM wrapper with 3 consumers: CLI, Flask, and load/scaling test. Works with HuggingFace models like Llama and TinyLlama (and...