Running LLMs locally with Ollama

Traditionally, large language models (LLMs) require high-end machines equipped with powerful GPUs due to their substantial memory and compute demands. However, recent advances have led to the emergence of smaller LLMs that can efficiently run on consumer-grade hardware. Tools like llama.cpp enable running these models directly on CPUs, making LLMs more accessible than ever. Installing and Running … Read more

How am I using GenAI?

Generative AI is rapidly gaining traction across industries, and software engineering is often cited as one of the fields poised for the most disruption. Personally, I’ve been slow to adopt GenAI tools in my day-to-day work. This post is a reflection on how I’m currently using them and where they’ve made an impact. ChatGPT & … Read more

Impact of DeepSeek

DeepSeek has released open-source GenAI models that outperform advanced OpenAI ones, creating well-deserved buzz. I see this as a defining moment for GenAI and AI—things are about to get really exciting. Challenge to dominance of USA in AI  Up to now, the U.S. has dominated the GenAI space. Top companies like OpenAI, Google, Microsoft, and … Read more