PyTorch Multi-Head Self-Attention

Problem Overview

This Uber Machine Learning Engineer phone screen asks you to implement multi-head self-attention in PyTorch from scratch. The interviewer is usually checking whether you understand:

• how queries,...