Traditionally, large language models (LLMs) require high-end machines equipped with powerful GPUs due to their substantial memory and compute demands. However, recent advances have led to the emergence of smaller LLMs that can efficiently run on consumer-grade hardware. Tools like llama.cpp enable running these models directly on CPUs, making LLMs more accessible than ever. Installing and Running…
Author: soubhagya
Reading Culture
Why Writing Culture Fails Without Reading Culture Most modern software companies pride themselves on their writing culture. Amazon, for instance, is often cited as the gold standard here. And they are right: writing has immense value. Well-written documents sharpen the writer’s thinking, align diverse stakeholders, and make communication asynchronous. Each reader can absorb the content at…
How am I using GenAI?
Generative AI is rapidly gaining traction across industries, and software engineering is often cited as one of the fields poised for the most disruption. Personally, I’ve been slow to adopt GenAI tools in my day-to-day work. This post is a reflection on how I’m currently using them and where they’ve made an impact. ChatGPT &…