Charles Dickens opens A Tale of Two Cities with one of the most quoted passages in literature: It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was…
Tag: LLM
Running LLMs locally with Ollama
Traditionally, large language models (LLMs) require high-end machines equipped with powerful GPUs due to their substantial memory and compute demands. However, recent advances have led to the emergence of smaller LLMs that can efficiently run on consumer-grade hardware. Tools like llama.cpp enable running these models directly on CPUs, making LLMs more accessible than ever. Installing and Running…
How am I using GenAI?
Generative AI is rapidly gaining traction across industries, and software engineering is often cited as one of the fields poised for the most disruption. Personally, I’ve been slow to adopt GenAI tools in my day-to-day work. This post is a reflection on how I’m currently using them and where they’ve made an impact. ChatGPT &…
Impact of DeepSeek
DeepSeek has released open-source GenAI models that outperform advanced OpenAI ones, creating well-deserved buzz. I see this as a defining moment for GenAI and AI—things are about to get really exciting. Challenge to dominance of USA in AI Up to now, the U.S. has dominated the GenAI space. Top companies like OpenAI, Google, Microsoft, and…