Brian CaffeyJBC
  • Blog
  • Contact
🏷️ All Tags 🏷️
llm 🏷️ (10)
  • A 2025 hackathon project that turned Hacker News stories into narrated video kept growing. This is what it does now, how each part works, and a set of things it made from one day's front page, all on models running at home.

    hn.fm, a year on: Hacker News as episodes, digests, a radio station and directed video

    A 2025 hackathon project that turned Hacker News stories into narrated video kept growing. This is what it does now, how each part works, and a set of things it made from one day's front page, all on models running at home.

    ai 🏷️
    llm 🏷️
    tts 🏷️
    hacker-news 🏷️
    hyperframes 🏷️
    hermes-agent 🏷️
    local-inference 🏷️

    Last updated November 13, 2026

  • My first LLM eval end-to-end: scoring NVIDIA's Nemotron-3-Nano-Omni-30B (NVFP4) on MMLU 5-shot via vLLM on a DGX Spark, with interactive charts breaking down where it's strong, where it's weak, and how confident it is.

    Running MMLU 5-shot on Nemotron Nano Omni with a DGX Spark

    My first LLM eval end-to-end: scoring NVIDIA's Nemotron-3-Nano-Omni-30B (NVFP4) on MMLU 5-shot via vLLM on a DGX Spark, with interactive charts breaking down where it's strong, where it's weak, and how confident it is.

    ai 🏷️
    llm 🏷️
    eval 🏷️
    mmlu 🏷️
    vllm 🏷️
    nemotron 🏷️
    dgx-spark 🏷️
    k8s 🏷️
    localmaxxing 🏷️

    Last updated June 18, 2026

  • An overview of my experience with the Google CodeLabs tutorial for deploying an AI model on GKE with NVIDIA NIM

    Deploying an AI model on GKE with NVIDIA NIM

    An overview of my experience with the Google CodeLabs tutorial for deploying an AI model on GKE with NVIDIA NIM

    nvidia 🏷️
    ai 🏷️
    llm 🏷️
    nim 🏷️
    gcp 🏷️
    gke 🏷️
    k8s 🏷️
    https://x.com/briancaffey/status/2025106078543888633

    Last updated February 20, 2026

  • hnfm transforms the Hacker News feed into your personalized AI-powered podcast

    hnfm: Building a Local-First AI Podcast Generator for Hacker News

    hnfm transforms the Hacker News feed into your personalized AI-powered podcast

    ai 🏷️
    llm 🏷️
    tts 🏷️
    flux 🏷️
    nuxt 🏷️
    fastapi 🏷️
    openai 🏷️
    gpt-oss 🏷️

    Last updated September 9, 2025

  • Mediation Simulator is an AI application designed to help legal students and professionals build dispute resolution skills through simulated mediation sessions

    Mediation Simulator: My submission for the NVIDIA Agent Intelligence Toolkit Hackathon

    Mediation Simulator is an AI application designed to help legal students and professionals build dispute resolution skills through simulated mediation sessions

    nvidia 🏷️
    ai 🏷️
    agents 🏷️
    llm 🏷️
    nim 🏷️
    mediation 🏷️
    https://x.com/briancaffey/status/1926036369597510117

    Last updated May 27, 2025

  • RedLM is an AI-powered application for the study of China's greatest classical novel: Dream of the Red Chamber

    RedLM: My submission for the NVIDIA and LlamaIndex Developer Contest

    RedLM is an AI-powered application for the study of China's greatest classical novel: Dream of the Red Chamber

    nvidia 🏷️
    llama-index 🏷️
    ai 🏷️
    llm 🏷️
    rag 🏷️
    tensorrt-llm 🏷️
    chinese 🏷️
    redology 🏷️
    https://x.com/briancaffey/status/1855186768452321330
    https://dev.to/briancaffey/redlm-my-submission-for-the-nvidia-and-llamaindex-developer-contest-1c3k

    Last updated November 9, 2024

  • This article is a brief discusion on recent updates to my project for the Generative AI Agents Developer Contest by NVIDIA and LangChain

    Agents of Inference: Speed of Light -- Accelerating my Generative AI Agents project with NVIDIA NIMs, TensorRT and TensorRT-LLM

    This article is a brief discusion on recent updates to my project for the Generative AI Agents Developer Contest by NVIDIA and LangChain

    nvidia 🏷️
    langchain 🏷️
    agents 🏷️
    rtx 🏷️
    gpu 🏷️
    tensorrt 🏷️
    tensorrt-llm 🏷️
    ai 🏷️
    llm 🏷️
    llama 🏷️
    007 🏷️
    stable-diffusion 🏷️
    stable-video-diffusion 🏷️
    comfyui 🏷️
    https://x.com/briancaffey/status/1802754703207583886

    Last updated June 24, 2024

  • This article discusses my entry for NVIDIA's Generative AI Agents Developer Contest entry: Agents of Inference

    Agents of Inference: My submission for NVIDIA's Generative AI Agents Developer Contest by NVIDIA and LangChain

    This article discusses my entry for NVIDIA's Generative AI Agents Developer Contest entry: Agents of Inference

    nvidia 🏷️
    langchain 🏷️
    agents 🏷️
    rtx 🏷️
    gpu 🏷️
    tensorrt 🏷️
    tensorrt-llm 🏷️
    ai 🏷️
    llm 🏷️
    llama 🏷️
    007 🏷️
    stable-diffusion 🏷️
    stable-video-diffusion 🏷️
    comfyui 🏷️
    https://x.com/briancaffey/status/1802754703207583886

    Last updated June 17, 2024

  • This article discusses my entry for NVIDIA's Generative AI on RTX PCs Developer Contest: Rocket League BotChat

    Rocket League BotChat powered by TensorRT-LLM: My submission for NVIDIA's Generative AI on RTX PCs Developer Contest

    This article discusses my entry for NVIDIA's Generative AI on RTX PCs Developer Contest: Rocket League BotChat

    nvidia 🏷️
    rtx 🏷️
    gpu 🏷️
    tensorrt-llm 🏷️
    ai 🏷️
    llm 🏷️
    llama 🏷️
    rocket-league 🏷️
    gaming 🏷️
    windows 🏷️
    https://twitter.com/briancaffey/status/1760529251072118901
    https://www.reddit.com/r/RocketLeague/comments/1au0po3/rocket_league_botchat_an_llmpowered_bakkesmod/
    https://dev.to/briancaffey/rocket-league-botchat-powered-by-tensorrt-llm-my-submission-for-nvidias-generative-ai-on-rtx-pcs-developer-contest-2oao

    Last updated February 17, 2024

  • Translating The Three-Body Problem book to English with Chinese LLMs, making visualizations with stable diffusion and running n-body simulations with CUDA

    Python, Vue, Chinese-LLaMA-2 and The Three-Body Problem

    Translating The Three-Body Problem book to English with Chinese LLMs, making visualizations with stable diffusion and running n-body simulations with CUDA

    three-body-problem 🏷️
    llama 🏷️
    llm 🏷️
    ai 🏷️
    chinese 🏷️
    python 🏷️
    nvidia 🏷️
    cuda 🏷️
    gpu 🏷️
    stable-diffusion 🏷️
    langchain 🏷️
    vue 🏷️
    three.js 🏷️
    https://news.ycombinator.com/item?id=38393757
    https://www.reddit.com/r/threebodyproblem/comments/1823l5j/python_vue_chinesellama2_and_the_threebody_problem/
    https://twitter.com/briancaffey/status/1727710878349332614

    Last updated November 23, 2023


Join my mailing list to get updated whenever I publish a new article.

Thanks for checking out my site!
© 2026 Brian Caffey