Soup CLI logo

Soup CLI

Soup CLI is an Apache-2.0 command-line tool that collapses the whole LLM post-training stack into one workflow: it inspects your data pre-flight, picks the method, writes the config (task, quantization, learning rate, and epochs come from rules rather than a search), derives evals from your own data, gates every save, and self-corrects reward hacking mid-run instead of just halting. Its headline trick is memory streaming - during LoRA the base model is frozen, so Soup keeps it in system RAM or NVMe and streams it into the GPU one decoder layer at a time with 4-bit quantization, making peak VRAM roughly one layer. Measured on a 4 GB RTX 3050 laptop, Llama-3.1-8B trains at 119.6 tokens per second in 3.32 GB peak, and DPO, ORPO, SimPO, and KTO stream too. It ships 23 methods, 142 recipes, 17 quant formats, and MLX/Apple adapters, and publishes every measurement including a self-reported correctness bug. Soup CLI is ideal for solo researchers and developers fine-tuning models on hardware that should not fit them.

Reader rating

No ratings yet

Visit website

You might also like

Related tools

View all
codemap favicon
codemap
No ratings yet

codemap is an MIT-licensed project brain for AI coding tools that gives LLMs instant architectural context from your codebase without burning tokens. It generates a fast tree/context view, dependency flow, dependency blast-radius analysis, and a layered handoff format for cross-agent continuation, then exposes everything through a JSON context bundle and an MCP server compatible with Claude Code and Codex. A built-in Codex plugin and community skill registry make it easy to install and share. Developers use codemap to onboard agents to large repos in seconds, keep session continuity across handoffs, and scope the impact of a change before running it.

View details
Ollama favicon
Ollama
No ratings yet

Ollama is a local AI platform for running, managing, and sharing open models on your own machine or private infrastructure. It makes it easy to pull models, serve them through an API, and integrate local inference into developer workflows without relying on a fully managed cloud stack. Teams use Ollama for privacy-sensitive assistants, internal tools, offline experimentation, and rapid testing of open-weight models across laptops, workstations, and servers. It is especially useful for developers, operators, and AI builders who want quick setup with less operational overhead. What makes Ollama distinctive is how approachable it is: it packages model runtime, distribution, and deployment into a streamlined experience that helps people get productive with local AI in minutes instead of spending days on configuration.

View details
FileForge Finder favicon
FileForge Finder
No ratings yet

FileForge Finder is an AI-powered local file search utility that optimizes search results for developer workflows. It uses natural language processing to understand query intent and prioritize relevant files, code snippets, and documentation. The tool integrates with popular IDEs and terminals to provide instant, context-aware file retrieval, reducing time spent navigating complex project structures. It supports multiple file formats and offers advanced filtering by content type, modification date, and relevance.

View details

From the blog

Related articles

View all
Branded HungryMinded cover reading AI Moves In for an article about AI tools entering daily workflows.
August 12, 2026 · 8 min read

The AI Tool War Is Moving Into Your Workflow

AI tools are moving from clever demos into the surfaces where real work happens: desktops, agents, creator workflows, and enterprise platforms…

A branded HungryMinded cover reading Buyer Checklists, about reviewing AI tools before they become part of a workflow.
August 11, 2026 · 7 min read

AI Tool Reviews Need To Become Buyer Checklists

AI tool reviews need to move past demos and check the boring things that decide whether a tool survives real work: price, limits, lock-in, review burden, and exit paths…

A branded HungryMinded cover reading Models Need Distribution, representing open AI models reaching users through existing coding workflows.
August 8, 2026 · 6 min read

Open Models Win When They Show Up Where You Work

Kimi K3 in GitHub Copilot shows why open models need more than benchmarks. The models that win are the ones inside real workflows…