Home

Transformer Architecture Explained in Detail from the scratch

Initially, I thought of writing an article on transformer architecture. However, I realized that it would go beyond some 90 pages if I cover every detail of it. So I thought of putting the presentation (which is almost self-reliant) prepared by me for the deep learning course taught at IITM by Prof.Mitesh Khapra. Here is the presentation (wait ...

Read more

A Point in Parameter Space and Fitting A Line in sample space

I struggle a lot whenever I learn new mathematical concepts and always sought for some sort of visualization to ease the learning process. I hope I am not alone. We are all comfortable at learning something by looking at the pictures from our childhood onwards. Our brain is wired like that. However, as we progress in the various stages of the ed...

Read more

A Random Process

3.RandomProcess A Random process could be thought of as a collection of indexed random variables (i.e., a vector) that evolves in time . Each RV (element) in a collection (vector) follows a specific distribution. If all RVs in a collection have the same distribution and are independent of each othe...

Read more

Linear Estimator For Random Process

layout: page keywords: “Estimation, Jupyter notebook” title: “Linear Estimator for a Random Process” date: 2021-05-21 tags: Estimator, Linearity, Probability, Jupyter-Notebook key: “LERP-2105” comment: true — 2.CovarianceAndEstimator Oftentimes, statistical averages such as mean, variance, $n$t...

Read more

Distribution of Random Variables

1.Random Variables In [1]: import numpy as np from matplotlib import pyplot as plt from matplotlib import transforms as trans from scipy import special plt.style.use('ggplot') In [2]: %matplotlib inline Let us simulate a coing tossing...

Read more

Causation vs Correlation (Tamil)

ஒவ்வொரு விளைவிற்கும்(காரியத்திற்கும்) ஒரு காரணம் இருக்கும் என்ற கருத்து அறிவியலில் மிக ஆழமானது. ஒரு பொருள் நகர்கிறது என்பது "விளைவு", ஏன் நகர்கிறது என்பதற்கான விடை "காரணம்". அறிவியலில், ஒரு பொருள் ஏன் நகர்கிறது என்ற சாதாரணமான(?) கேள்வியில் ஆரம்பித்து இந்த பிரபஞ்சம் ஏன் விரிகிறது போன்ற அசாதாரணமான கேள்விகளுக்கான விடைகள் இந்த காரண-காரிய (...

Read more