Skip to main content

I build AI systems that read markets for you.

I'm Kit, an engineer in Vancouver. I build LLM pipelines and agents, the serving layer under them, and the low-latency infrastructure and data systems that trading runs on.

Stack

What the projects above are written in, the AI tools I build with every day, and the infrastructure I run, from a Proxmox homelab to servers in several regions. Grab a ball and spin it.

Languages and frameworks

RustGoTypeScriptPythonReactNext.jsSolanaPostgreSQLSQLite

AI tools and training

Claude CodeCodexOpenCodePerplexityPyTorchHugging FaceComfyUILoRAOllama

Infrastructure, home and cloud

LinuxArch LinuxProxmoxSynology NASQEMU / KVMDockerKubernetesAnsibleCloudflareAWSGoogle CloudVercel

AI systems

LLM pipelines and agents I run, the serving layer under them, and the tools that let other agents use my data. The LLM-Digest case study replays one real run.

  • 9

    LLM-Digest

    A nine-stage pipeline, a RAG agent with cited answers and one model layer with fallbacks, running every hour.

    Case study
  • 2.83×

    KV-cache serving

    4-bit KV and block-sparse Triton kernels under a learned vLLM scheduler on one RTX 3090.

    Case study
  • ~20 tools

    MCP servers

    Open-sourced TypeScript and Python MCP servers that give AI agents RootData's crypto data as tools, over stdio, SSE and Cloudflare Workers.

    GitHub
  • 27B

    Local inference

    Quantized 27B models and vision models on a single 24 GB card with llama.cpp, Ollama and vLLM.

    Notes

Writing

Longer notes on how these were built. All posts are on the Blog; earlier research, VC and coding notes are in the Notebook.

Write to me

I'm in Burnaby, BC, on Pacific time.

Send an email

Photographs from Wikimedia Commons: fog in the Savoureuse valley by Thomas Bresson (CC BY 3.0); Mystic Beach, Vancouver Island by Michal Klajban (CC BY-SA 4.0).