Traditionally, large language models (LLMs) require high-end machines equipped with powerful GPUs due to their substantial memory and compute demands. However, recent advances have led to the emergence of smaller LLMs that can efficiently run on consumer-grade hardware. Tools like llama.cpp enable running these models directly on CPUs, making LLMs more accessible than ever. Installing and Running…
Tag: LLM
How am I using GenAI?
Generative AI is rapidly gaining traction across industries, and software engineering is often cited as one of the fields poised for the most disruption. Personally, I’ve been slow to adopt GenAI tools in my day-to-day work. This post is a reflection on how I’m currently using them and where they’ve made an impact. ChatGPT &…