GenAI has made writing and editing content very easy. One can use ChatGPT or Claude to write a blog post or improve one. On one end, one can use these tools to check basic grammatical and spelling mistakes. On the other end, one can use these tools to drastically alter the content and style. One…
Category: Gen AI
Using GenAI for Effective Learning
While I was a student of Aerospace Engineering, I was doing a project under Prof Rao. I was given a research paper on simulating tsunami waves. The paper was quite complicated, involving a lot of higher mathematics. I was able to comprehend it with the help of Google Search. I felt somewhat proud of my…
TokenMaxxing and Goodhart’s Law
Management requires measuring effectiveness and efficiency. To measure efficiency, we need some metrics. Metrics are used to demonstrate if an initiative is succeeding or failing. Metrics are also used to measure how one person is performing against another. Metrics make comparisons data driven and objective. The first challenge is finding the right set of metrics. …
The Best of Times, The Worst of Times
Charles Dickens opens A Tale of Two Cities with one of the most quoted passages in literature: It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was…
RAG : Retrieval Augmented Generation
What is the need for RAG? LLMs are taught on a vast amount of data. They can answer queries based on the trained data set. If you ask any query about things not covered in the dataset, LLMs may hallucinate and provide incorrect answers. LLMs are very powerful, but are also costly to train. Only…
Running LLMs locally with Ollama
Traditionally, large language models (LLMs) require high-end machines equipped with powerful GPUs due to their substantial memory and compute demands. However, recent advances have led to the emergence of smaller LLMs that can efficiently run on consumer-grade hardware. Tools like llama.cpp enable running these models directly on CPUs, making LLMs more accessible than ever. Installing and Running…
How am I using GenAI?
Generative AI is rapidly gaining traction across industries, and software engineering is often cited as one of the fields poised for the most disruption. Personally, I’ve been slow to adopt GenAI tools in my day-to-day work. This post is a reflection on how I’m currently using them and where they’ve made an impact. ChatGPT &…
Impact of DeepSeek
DeepSeek has released open-source GenAI models that outperform advanced OpenAI ones, creating well-deserved buzz. I see this as a defining moment for GenAI and AI—things are about to get really exciting. Challenge to dominance of USA in AI Up to now, the U.S. has dominated the GenAI space. Top companies like OpenAI, Google, Microsoft, and…