Home

Pytorch for Deep Learning

Theory is not enough, you must apply. The objective of this workshop is to give you hands on experience in building models using the pytorch's core component called Tensor . Beleive me, everything you are gonna build is simply stacking or connecting copies of this single core component!. It make sense as all the models takes in Tensors (data) a...

Read more

கணிப்போம் வா

"கண்ணா, வெளியில விளையாடப் போறயா, குடை எடுத்துட்டு போப்பா, மழை வர 60% வாய்ப்பிருக்குனு (Chance) போட்ருக்குப்பா ", என்றாள் திண்ணையில் ஸ்மார்ட் போனை ஸ்க்ரால் செய்தபடி அமர்ந்திருந்த பாட்டி. "அட போ பாட்டி, வெயில் கொளுத்துது" என்று அவள் சொன்னதை அசட்டை செய்து விட்டு சென்றான் பேரன் ஹரி . இவர்களது பேச்சை கேட்டவாறே வீட்டினுள் சென்றாள் பேத்தி மீனா . ...

Read more

Gradient as a Guide : A Simple Game

Gradient as a Guide : A Simple Game   The Backpropagation algorithm is the powerhouse of all Deep Learning models. It is one of the methods of efficiently calculating Gradient for billions of parameters. Therefore, it is vital to understand how the Gradient information g...

Read more

Bringing Python to Browser!

Jupyter notebook has always been a de-facto choice when you teach the Python programming language or while developing prototype machine learning models or doing exploratory data analysis. The reasons are manifold. The most important reason is due to its ability to interleave the rich set of explanatory notes using markdown cells and ...

Read more

Making Sense of Positional Encoding in Transformer

Motivation Are you wondering about the peculiar use of a sinusoidal function to encode the positional information in Transformer architecture? Are you asking why not just use simple one-hot encoding or something similar to encode positions?. Welcome, this article is for you. Perhaps you are here after reading a few articles explaining the posit...

Read more

Transformer Architecture Explained in Detail from the scratch

Initially, I thought of writing an article on transformer architecture. However, I realized that it would go beyond some 90 pages if I cover every detail of it. So I thought of putting the presentation (which is almost self-reliant) prepared by me for the deep learning course taught at IITM by Prof.Mitesh Khapra. Here is the presentation (wait ...

Read more

A Point in Parameter Space and Fitting A Line in sample space

I struggle a lot whenever I learn new mathematical concepts and always sought for some sort of visualization to ease the learning process. I hope I am not alone. We are all comfortable at learning something by looking at the pictures from our childhood onwards. Our brain is wired like that. However, as we progress in the various stages of the ed...

Read more

A Random Process

3.RandomProcess A Random process could be thought of as a collection of indexed random variables (i.e., a vector) that evolves in time . Each RV (element) in a collection (vector) follows a specific distribution. If all RVs in a collection have the same distribution and are independent of each othe...

Read more