My final year project is Chase-the-cloud: Cloud motion prediction using INSAT 3DR data. And, it’s been some time since I’ve sat down to write about what I have been working on. And to be fair, this project has made me question my life’s existence more than any other project, like ever. So, let’s talk about it. To make you interested in what we’re going to be talking about, here’s a picture of a trained model’s prediction: ...
With the advancements in AI, there have been a lot of problems that have seen ideas from statistics and math applied to them. One of them is retrieval. We can broadly look at retrieval as: same modal retrieval cross modal retrieval What I want to discuss today is different ways we can embed information in a vector space from one modality and use a different modality to access that information. ...
Recently, at PyTorch Day India in Bangalore, I saw a talk on AI compilers. Here is the link: YouTube Picture from the session I didn't know there were Indian labs working on the AI compiler problem. But it turns out there are. PolyMage Labs is an IISc lab in Bangalore working on PolyBlocks. Since AI is moving fast, there is a clear need for efficient AI compilers that can lower high-level tensor programs to IR for GPUs, TPUs, and other backends. PolyBlocks minimizes dependency on external vendor libraries like cuBLAS/cuDNN while still generating highly optimized code via compiler-driven transformations and tiling. ...
Before we see what torch.compile does, we should first understand pytorch’s default mode and why we’d ever want to move away from it. PyTorch runs in eager mode by default. Think of it as PyTorch reading and executing your code op by op, as Python encounters each line. It’s immediate, flexible, and great for prototyping — but it pays a Python interpreter cost on every single operation. For production and deployment, we want to skip that cost. That’s where compilation comes in. ...