Skip to content
View cduggn's full-sized avatar
🛸
breaking stuff
🛸
breaking stuff

Highlights

  • Pro

Block or report cduggn

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
cduggn/README.md

Colin / cduggn

Somewhere between the GPU and the Sprawl.

I'm working on inference engineering. Interested in how models run, where the bottlenecks are, and what we can squeeze out of the hardware.

Neuromancer, Snow Crash, Blade Runner, and Kafka on the Shore are my kind of fiction. I like neural interfaces and ideas that sound a bit unhinged but might actually work.

AI does most of the hard graft these days. I still enjoy digging through code and working out engineering problems. Having something else write the code hasn't made me any less interested in understanding it.

inference engineering · neural interfaces · systems · plausible science fiction

Pinned Loading

  1. ccExplorer ccExplorer Public

    ccExplorer (Cloud cost explorer) is a simple command line tool to explore the cost of your cloud resources.

    Go 48 2

  2. tmc/langchaingo tmc/langchaingo Public

    LangChain for Go, the easiest way to write LLM-based programs in Go

    Go 9.8k 1.2k

  3. Ariadne Ariadne Public

    Read-only Kubernetes cluster doctor on self-hosted inference (vLLM + gateway) — inference engineering final project

    Jupyter Notebook 1

  4. ariadne-gateway ariadne-gateway Public

    Rust port of the Ariadne inference gateway: guard, admit, place and queue chat completions in front of vLLM workers

    Rust

  5. homebrew-cduggn homebrew-cduggn Public

    Homebrew tap

    Ruby

  6. lambda-cli lambda-cli Public

    lam: Lambda Cloud CLI + cloud-init bootstrap (launch/ssh/terminate GPU boxes without the console)

    Go 1