designed_to_flowtraining-serving-skew.mdx
● 28 lessons · freealexkazos.com ↗

Training-serving skew

Why does a model that tested well do worse in production?

⏱ 9 min☰ 10 steps▶ playground
Test set
90.3%
Training data182,876 URLsfeatures · trainpandas, batchLive URLone URL per requestfeatures · serveper requestClassifierRandom ForestVerdictphishing or safetwo feature pathsfeaturetrainingservingURLLength……NumSlashes……
features · trainfeatures · serveClassifierVerdicttwo feature pathsfeaturetrainingservingURLLength……NumSlashes……
  • data moving
  • changed in this step