$ yardstyx --version yardstyx 0.1.0 $ yardstyx download ggml-org/models --file tinyllamas/stories15M-q4_0.gguf --dir ./models Downloading: tinyllamas/stories15M-q4_0.gguf → models/stories15M-q4_0.gguf stories15M-q4_0.gguf ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.1/19.1 MB 12.9 MB/s 0:00:00 ✓ Downloaded: stories15M-q4_0.gguf (18.2 MB) ✓ SHA256 verified $ yardstyx info ./models/stories15M-q4_0.gguf ╭────────────────────────────── stories15M-q4_0.gguf ──────────────────────────────╮ │ │ │ Architecture llama │ │ Name llama │ │ Context length 128 │ │ Embedding length 288 │ │ Layer count 6 │ │ Attention heads 6 │ │ Tokenizer model llama │ │ File size 18.2 MB │ │ GGUF version 3 │ │ │ ╰──────────────────────────────────────────────────────────────────────────────────╯ $ yardstyx run fast ./models/stories15M-q4_0.gguf --ngl 0 --ctx 256 --port 18081 Preset: fast ctx=256 ngl=0 port=18081 Model: stories15M-q4_0.gguf ✓ Server up on :18081 alias: stories15M-q4_0 $ yardstyx health --port 18081 ● Server up :18081 llamacpp:prompt_tokens_total 0 llamacpp:prompt_tokens_cached_total 0 llamacpp:prompt_seconds_total 0 llamacpp:tokens_predicted_total 0 llamacpp:tokens_predicted_seconds_total 0 llamacpp:n_decode_total 0 llamacpp:n_tokens_max 0 llamacpp:spec_decode_num_draft_tokens_total 0 llamacpp:spec_decode_num_accepted_tokens_total 0 llamacpp:spec_decode_num_drafts_total 0 llamacpp:prompt_tokens_seconds 0 llamacpp:predicted_tokens_seconds 0 $ yardstyx stop --port 18081 Stopped PID 689651 Stopped 1 process(es).