<p class=lexical__paragraph dir=ltr><span style=white-space: pre-wrap;>我想要一天分享一點「</span><b>從底層堆疊的技術</strong></b><span style=white-space: pre-wrap;>」,並且每篇文章長度控制在三分鐘以內,讓大家不會壓力太大,但是又能夠每天成長一點。</span></p><p class=lexical__paragraph><br></p><p class=lexical__paragraph dir=ltr><span style=white-space: pre-wrap;>目前我們已經完成:</span></p><ul class=lexical__ul><li value=1 class=lexical__listItem>-Head Attention 數學說明:</span><a href=https://vocus.cc/article/667b7a06fd89780001c3a315 target=_blank>說書 - 從0開始 - 52</span></a></li><li value=2 class=lexical__listItem>-Head Attention 數學說明:</span><a href=https://vocus.cc/article/667bac83fd89780001c77dbc target=_blank>說書 - 從0開始 - 53</span></a></li><li value=3 class=lexical__listItem> 機制程式說明 - 輸入端:</span><a href=https://vocus.cc/article/667bac83fd89780001c77dbc target=_blank>說書 - 從0開始 - 53</span></a></li><li value=4 class=lexical__listItem> 機制程式說明 - Query 端:</span><a href=https://vocus.cc/article/667cc5fcfd89780001d63a93 target=_blank>說書 - 從0開始 - 54</span></a></li><li value=5 class=lexical__listItem> 機制程式說明 - Key 端:</span><a href=https://vocus.cc/article/667cc5fcfd89780001d63a93 target=_blank>說書 - 從0開始 - 54</span></a></li><li value=6 class=lexical__listItem> 機制程式說明 - Value 端:</span><a href=https://vocus.cc/article/667ccb49fd89780001d6a75f target=_blank>說書 - 從0開始 - 55</span></a></li><li value=7 class=lexical__listItem> 機制程式說明 - Query 、 Key 、 Value 結果:</span><a href=https://vocus.cc/article/667cd20dfd89780001d72f80 target=_blank>說書 - 從0開始 - 56</span></a></li><li value=8 class=lexical__listItem> 機制程式說明 - Attention Score 計算:</span><a href=https://vocus.cc/article/667cdc8cfd89780001d80799 target=_blank>說書 - 從0開始 - 57</span></a></li><li value=9 class=lexical__listItem> 機制程式說明 - Attention Score 正規化計算:</span><a href=https://vocus.cc/article/667d1c1ffd89780001dca70d target=_blank>說書 - 從0開始 - 58</span></a></li><li value=10 class=lexical__listItem> 機制程式說明 - 輸出結果計算:</span><a href=https://vocus.cc/article/667e1247fd897800015fe9f1 target=_blank>說書 - 從0開始 - 59</span></a></li></ul><p class=lexical__paragraph><br></p><p class=lexical__paragraph dir=ltr><span style=white-space: pre-wrap;>針對 </span><a href=https://vocus.cc/article/667e1247fd897800015fe9f1 target=_blank>說書 - 從0開始 - 59</span></a><span style=white-space: pre-wrap;> 的計算,我們得到以下矩陣結果:</span></p><div class=lexical__image center><div class=lexical__imageWrapper><img src=https://d2a6d2ofes041u.cloudfront.net/resize?compression=6&norotation=true&url=https%3A%2F%2Fimages.vocus.cc%2F58022ece-bb8a-46fa-8d66-2639793f6012.png&width=522&sign=6oD0iqkNSzdOH9GyNX7MK2X7BPmNd-pPDnCXHplUjAo data-src=https://d2a6d2ofes041u.cloudfront.net/resize?compression=6&norotation=true&url=https%3A%2F%2Fimages.vocus.cc%2F58022ece-bb8a-46fa-8d66-2639793f6012.png&width=522&sign=6oD0iqkNSzdOH9GyNX7MK2X7BPmNd-pPDnCXHplUjAo class=lazy data-original-src=https://images.vocus.cc/58022ece-bb8a-46fa-8d66-2639793f6012.png data-lowquality=true data-width=522 data-height=210 alt=raw-image></div><div></div></div><p class=lexical__paragraph><br></p>