Machine learning

ML related stuff

Understanding Attention

Attention is used everywhere now. And it's not super intuitive at first glance

Part 1 - Understanding the input

Part 2 - Understanding the equation (COMING SOON)

Derivatives

Sometimes you get curious and want to dive a bit deeper into the gradients calculations.

What is the derivative of ReLU?

How to Compute the Derivative of a Sigmoid Function

Metrics

How "good" is your model performing? This seems like a simple question. But it's not.

True, false, positives, and negatives

Weighted precision and recall

Normalization

Normalize vectors to unit (L1 and L2) norm