$ cat client-server-llm.md
Client-Server LLM in C
Multithreaded TCP/HTTP server in C routing concurrent prompts to a local LLM.
- C
- POSIX Sockets
- pthreads
- HTTP
Overview
A networking and systems project focused on concurrency: a multithreaded TCP/HTTP server that accepts concurrent client prompts and routes them to a locally running LLM.
What I built
- POSIX sockets and pthreads for concurrent request handling
- fork/exec and pipes to manage the local LLM process, with signal handling for clean shutdown
- JSON parsing and shared-state synchronisation across threads to keep concurrent prompt routing correct