Your verification ID is: guDlT7MCuIOFFHSbB3jPFN5QLaQ Big Computing: The Five Stages of Model Learning

Monday, February 8, 2016

The Five Stages of Model Learning

Each time I learn to use a new predictive model I find that I go through five stages of emotion before I truly add that model to my toolbox.

The first stage is wonder: This is when I use the model with the data in the vignettes and everything just works out beautifully and magically. The model runs. The results are awesome. I am just over the moon every time I am in this stage. I think to myself things like "why haven't I used this model before?", "I should use this model all the time?" and "This is the greatest model ever!!!".

The second stage is frustration: Yes, every Data Scientist has experienced this most awful stage. This happens the first time you try to apply the Model to real data. First, there are the errors when the data is not in the right format for the model. Then there are the crazy answers and model crashes. I know I am about to end this stage when I get the first results back, and they totally suck.

The Third Stage is acceptance: This stage happens as you use the model more and more and see that there are some cases where it works well and other where it does not. I usually get to this stage, but there are cases where I abandon the model before I see it do well against a real world data set.

The Fourth Stage is understanding: This is when you start to read more about the model. What makes it work? What makes it work better? What should you look for in a set data to determine if this models is good to try? When I get to this stage I know I am learning and improving my skills

The Fifth Stage is adoption: This happens when you have used the model enough and understand how it works enough to know when and how to use the model. This is the moment the model enters my toolbox as a permanent resident to be used when the data calls for it. I do not always get to this stage, but when I do I know I have achieved something.

Understanding that this is the process of learning a new predictive model will make you more willing to go through the process because the end result is so good. Good luck and keep learning.

10 comments:

  1. What's with the arabic spam dammit?
    Anyway, thanks. Helped alot.

    ReplyDelete
  2. I would like to thank you for the efforts you have made in writing this article.
    run2online.net

    ReplyDelete
  3. I am really impressed with your blog article, such great & useful information you mentioned here. I have read all your posts and all are very informative. Thanks for sharing and keep it up like this. Comprehensive In-Store Analytics UAE

    ReplyDelete
  4. Hi there, after reading this remarkable paragraph i am too happy to share my experience here with friends. 토토사이트

    ReplyDelete
  5. Attractive element of content. I simply stumbled upon your site and
    in accession capital to say that I acquire in fact enjoyed account your blog posts.
    Any way I’ll be subscribing on your feeds or even I success 스포츠토토

    you get entry to persistently fast.

    ReplyDelete
  6. I believe other website owners should take this site as
    an example, very clean and wonderful user pleasant style and design. 바카라사이트

    ReplyDelete
  7. ทาง เข้า pg slot auto หรือ pg-slot.game เกมพีจีสล็อต pg สล็อตออนไลน์ 3 มิติ (pg slot auto) จากค่าย pg slot และ บาคาร่าออนไลน์ ที่มาในรูปแบบใหม่เป็นเกมส์ยอดนิยม

    ReplyDelete
  8. slotpg รูปแบบใหม่ต้องใจผู้เล่น เกมคาสิโนออนไลน์ที่เยี่ยมที่สุด บริการครบวงจรในเรื่องความเพลิดเพลินและก็เงินรางวัลหลายชิ้น สล็อตออนไลน์เล่นไม่ยาก ชำระเงินจริงทุกบาททุกเงิน

    ReplyDelete