<p class=lexical__paragraph dir=ltr><span style=white-space: pre-wrap;>我想要一天分享一點「</span><b>從底層堆疊的技術</strong></b><span style=white-space: pre-wrap;>」,並且每篇文章長度控制在三分鐘以內,讓大家不會壓力太大,但是又能夠每天成長一點。</span></p><p class=lexical__paragraph dir=ltr><br></p><p class=lexical__paragraph dir=ltr><span style=white-space: pre-wrap;>目前我們已經完成:</span></p><ul class=lexical__ul><li value=1 class=lexical__listItem>-Head Attention 數學說明:</span><a href=https://vocus.cc/article/667b7a06fd89780001c3a315 target=_blank>說書 - 從0開始 - 52</span></a></li><li value=2 class=lexical__listItem>-Head Attention 數學說明:</span><a href=https://vocus.cc/article/667bac83fd89780001c77dbc target=_blank>說書 - 從0開始 - 53</span></a></li><li value=3 class=lexical__listItem> 機制程式說明 - 輸入端:</span><a href=https://vocus.cc/article/667bac83fd89780001c77dbc target=_blank>說書 - 從0開始 - 53</span></a></li><li value=4 class=lexical__listItem> 機制程式說明 - Query 端:</span><a href=https://vocus.cc/article/667cc5fcfd89780001d63a93 target=_blank>說書 - 從0開始 - 54</span></a></li><li value=5 class=lexical__listItem> 機制程式說明 - Key 端:</span><a href=https://vocus.cc/article/667cc5fcfd89780001d63a93 target=_blank>說書 - 從0開始 - 54</span></a></li><li value=6 class=lexical__listItem> 機制程式說明 - Value 端:</span><a href=https://vocus.cc/article/667ccb49fd89780001d6a75f target=_blank>說書 - 從0開始 - 55</span></a></li><li value=7 class=lexical__listItem> 機制程式說明 - Query 、 Key 、 Value 結果:</span><a href=https://vocus.cc/article/667cd20dfd89780001d72f80 target=_blank>說書 - 從0開始 - 56</span></a></li><li value=8 class=lexical__listItem> 機制程式說明 - Attention Score 計算:</span><a href=https://vocus.cc/article/667cdc8cfd89780001d80799 target=_blank>說書 - 從0開始 - 57</span></a></li><li value=9 class=lexical__listItem> 機制程式說明 - Attention Score 正規化計算:</span><a href=https://vocus.cc/article/667d1c1ffd89780001dca70d target=_blank>說書 - 從0開始 - 58</span></a></li></ul><p class=lexical__paragraph dir=ltr><br></p><p class=lexical__paragraph dir=ltr><span style=white-space: pre-wrap;>接著回顧 </span><a href=https://vocus.cc/article/667b7a06fd89780001c3a315 target=_blank>說書 - 從0開始 - 52</span></a><span style=white-space: pre-wrap;> :</span></p><div class=lexical__image float><div class=lexical__imageWrapper><img src=https://d2a6d2ofes041u.cloudfront.net/resize?compression=6&norotation=true&url=https%3A%2F%2Fimages.vocus.cc%2F245ef9dd-322c-4bb4-93df-5277a484d68e.png&width=740&sign=Hu7Oxge3jugJmeiCdMVkzviFB4u6aV-kQ7gMUtRw7os data-src=https://d2a6d2ofes041u.cloudfront.net/resize?compression=6&norotation=true&url=https%3A%2F%2Fimages.vocus.cc%2F245ef9dd-322c-4bb4-93df-5277a484d68e.png&width=740&sign=Hu7Oxge3jugJmeiCdMVkzviFB4u6aV-kQ7gMUtRw7os class=lazy data-original-src=https://images.vocus.cc/245ef9dd-322c-4bb4-93df-5277a484d68e.png data-lowquality=true data-width=760 data-height=606 alt=raw-image></div><div></div></div><ul class=lexical__ul><li value=1 class=lexical__listItem><span style=white-space: pre-wrap;>我們已經在 </span><a href=https://vocus.cc/article/667cdc8cfd89780001d80799 target=_blank>說書 - 從0開始 - 57</span></a><span style=white-space: pre-wrap;> 得到:</span></li></ul><pre spellcheck=false data-highlight-language=py> </span><span class=lexical__tokenOperator style=white-space: pre-wrap;>=</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenPunctuation style=white-space: pre-wrap;>[</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>1</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>2</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>2</span><br><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>2</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>8</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>6</span><br><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>3</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>0</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>3</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenPunctuation style=white-space: pre-wrap;>]</span></pre><ul class=lexical__ul><li value=1 class=lexical__listItem><span style=white-space: pre-wrap;>然後在 </span><a href=https://vocus.cc/article/667d1c1ffd89780001dca70d target=_blank>說書 - 從0開始 - 58</span></a><span style=white-space: pre-wrap;> 得到:</span></li></ul><pre spellcheck=false data-highlight-language=py>' </span><span class=lexical__tokenOperator style=white-space: pre-wrap;>=</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenPunctuation style=white-space: pre-wrap;>[</span><span class=lexical__tokenProperty style=white-space: pre-wrap;>0.063</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>6.033e-06</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>2.953e-04</span><br><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>0.468</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>9.820e-01</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>8.805e-01</span><br><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>0.468</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>1.798e-02</span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenProperty style=white-space: pre-wrap;>1.191e-01</span><span class=lexical__tokenPunctuation style=white-space: pre-wrap;>]</span></pre><p class=lexical__paragraph dir=ltr><span style=white-space: pre-wrap;>僅需再執行 :</span></p><pre spellcheck=false data-highlight-language=javascript></span><span style=white-space: pre-wrap;> </span><span class=lexical__tokenOperator style=white-space: pre-wrap;>=</span><span style=white-space: pre-wrap;> </span></span><span style=white-space: pre-wrap;> @ </span></span><span style=white-space: pre-wrap;>'</span></pre><p class=lexical__paragraph dir=ltr><br></p><p class=lexical__paragraph dir=ltr><br></p><p class=lexical__paragraph dir=ltr><br></p>