top of page


We Built Our Own ChatGPT style inference on a single desktop GPU
If you've ever pasted a chunk of code into a public AI chatbot to fix an error, you know how useful it is. But have you ever stopped to think about where that code actually goes? That was one of the questions the team at Whileone kept coming back to. The honest answer is: to a server somewhere, owned by someone else. For a cookie recipe that's fine. For the code we write for clients, the team felt it wasn't good enough. So, we decided to run its own AI model, on its own hardw

Akshay Bhide
Oct 216 min read
Â
Â
Â
bottom of page

