Out-of-Domain
When the production data is significantly different from the training distribution.
note
-
-
Proxy Metrics
Metrics are usually a proxy for what we really care about
-
Fleeting Notes
Temporary captures of ideas to be processed into permanent notes.
-
Literature Notes
Notes that capture source material in your own words, as an intermediate step toward permanent notes.
-
Permanent Notes
Atomic, self-contained notes that capture a single idea and link to related ones.
-
Survivorship Bias
arriving at false conclusions by only examining success cases
-
Latticework of Mental Models
Building a broad network of concepts across disciplines so ideas can reinforce each other.
-
Teaching the whole game
Starting with the big picture.
-
Adversarial Validation
A technique for measuring how different your test set is from your training set.
-
