leetcrypt 220fc74eb6 test(ai): add 25-query benchmark harness + results for ai mode models
Adds a repeatable AI-mode benchmark (ai-benchmark.sh) covering 25 queries across
8 categories and 3 difficulty tiers, plus captured latency results and manual
correctness grades for qwen2.5-coder:1.5b, qwen2.5:3b, and westenfelder/NL2SH.

Headline finding: on the larger suite NL2SH is most accurate (72% vs coder 40%,
3b 32%) and the only model with non-zero hard-task accuracy (50% vs coder 0%),
while qwen2.5-coder is ~2x faster (median 3.0s vs 6.3s). This reverses the
earlier 7-query result that favored qwen-coder overall.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-06-09 15:53:24 -07:00
2025-10-27 20:19:45 -07:00
2025-10-27 20:19:45 -07:00

super-man

An interactive, fuzzy command + man-page flag browser for the terminal. Search 260+ commands, drill into any one to fuzzy-search its flags with live descriptions, and jump back to the command list instantly.

Demo

super-man demo

Video (MP4): demo/super-man-demo.mp4 · asciinema cast: demo/super-man-demo.cast

The clip shows opening an entry (grep), browsing its flags, then pressing Esc to return straight to the home screen — no intermediary step — and repeating with tar.

Usage

super-man                       # interactive home screen (fzf)
super-man <command> [filter]    # jump straight to a command's flags
super-man -l, --list            # list all known commands
super-man -h, --help            # full help

# Natural-language modes (database-backed, needs jq)
super-man ask "find large files"        # ask a question
super-man task "monitor cpu usage"      # describe what you want to do
super-man category files                # browse by category (files/text/network/system)
super-man explain "tar -czf"            # explain what a command does
super-man ai "count lines in js files"  # AI bash one-liner via local LLM (advanced)

AI mode (local LLM via ollama)

ai generates a bash one-liner from plain English using a local ollama model. The model is configurable, so you can A/B different local LLMs:

super-man ai "find python files modified last week"          # default model
super-man ai --model qwen2.5:3b "count lines in all js files"  # override model
super-man ai --compare "list the 5 largest files"             # run several models side by side
Env var Purpose Default
SUPERMAN_AI_MODEL Default model for ai qwen2.5-coder:1.5b
SUPERMAN_AI_COMPARE_MODELS Space-separated list for --compare qwen2.5-coder:1.5b westenfelder/NL2SH

General coder models (e.g. qwen2.5-coder) are prompt-wrapped to emit a single bare command; the purpose-built westenfelder/NL2SH model receives the raw query. Pull either with ollama pull <model>.

Esc in the flag browser returns to the command list; Esc on the home screen exits.

Requirements: jq for the natural-language modes, fzf for interactive mode.

See docs/ for design notes and the full feature history.

S
Description
Token-friendly interactive man-page / command flag browser (fzf-based)
Readme 3.9 MiB
Languages
Shell 100%