Harkanwal Bedi

Staff Forward Deployed AI Engineer @ Google Seattle, WA

Open source

All projects
  • Merged C++

    ggml-org/llama.cpp #30779 

    llama-server now visits parent slots before their child slots, so requests that share a prompt prefix no longer need a third forward pass. Released in b12188.

  • Merged Python

    AI-Hypercomputer/maxdiffusion #476 

    Skips the CUDA-only nvidia-cuda-cccl dependency on macOS, where no wheels exist, so local installs no longer fail on Apple Silicon.