本系列將討論 LLM 時代中，分散 ML workload 的各種方法。作為系列的第一篇，我們將提及 High-level 的概論，譬如分散式訓練的各種切法、Model Parallelism 的相依問題，以及改善 Network Topology 等課題。

學習

職場

以行動支持創作者！付費即可解鎖

軟體開發

旅美工程師，閒談矽谷與北美的各種樣貌。
#矽谷 #工程師生涯 #旅行 #軟體工程 #個人成長

Medium: medium.com/mencher-publication

曼徹的矽谷旅記 Mencher’s Travelogue

ML Infra 一大戰場 - 分散式訓練

2023 年的 AI 革命主旋律，看似就圍繞 ChatGPT，或是 Sora 這種生成 AI 影片的 GenAI 。事實上，和人們日常息息相關的氣象預報，在 2023 年也同樣掀起 AI 革命，並對全球氣象預報產生顯著的影響。

音樂藝文

文化生活

科技

當氣象預報也 AI Powered

2024 年，AI Boom 的第二年，我們總算可以撥開 AI 迷霧，逐一聊聊大型語言模型 (LLM) 的實際應用。On-Device AI 正快速進化，Google Gemini Nano 正式部署上手機，Apple 也發布最新論文彎道超車，改變了手機 AI 的未來發展。

投資理財

#TeamPixel, we come bearing gifts! 🎁

#Pixel8 Pro is now running Gemini Nano, Google’s most efficient model built for on-device tasks, that powers helpful new AI features like Summarize in Recorder¹ 📝 and Smart Reply in Gboard.²  💬

But that’s not all! More new features just dropped that make your Pixel (even older ones) feel new again:
💡Balance and improve lighting in any pic with Portrait Light³
🌃Record vibrant timelapse videos in low light with Night Sight⁴
🐱Sharpen pics of your dogs and cats with Photo Unblur⁵
🎥Auto adjust color, lighting, stabilization, and more with Video Boost⁶
🌙See rich detail and color, even when it’s dark, with Night Sight Video⁶ 
👩‍👧‍👦Get the crew picture-ready with Dual Screen preview on #PixelFold
🧑‍💻Use Pixel as a webcam for crisp video calls from your computer⁷
🗣️Enhance your voice on video calls with Clear Calling on #PixelTablet ⁸
👤Pair #PixelBuds Pro to Pixel Tablet for immersive spatial audio with head tracking⁹
📞Respond to unknown callers with smarter replies in Call Screen¹⁰
🧽Spruce up your scanned docs with Clean in the Camera app¹¹
🎉And more!

Learn more about Gemini Nano and Pixel’s latest #FeatureDrop ¹² at the Google Store: https://goo.gle/416hsHn

¹Available only on Pixel 8 Pro in English.
²Available globally only on Pixel 8 Pro in developer settings using the United States English keyboard language. Available now in WhatsApp, coming to more apps next year. See https://developer.android.com/gboard-smart-reply for details.
³Available on Pixel Tablet, Pixel Fold, Pixel 6 and newer phones.
⁴Available only on Pixel 8 and Pixel 8 Pro. Requires Google Photos app.
⁵Available on Pixel Tablet, Pixel Fold, Pixel 6 and later phones.
⁶Available only on Pixel 8 Pro. Requires Google Photos app.
⁷Available on Pixel Fold, Pixel 6 and newer phones. Requires compatible devices that support UVC (USB Video Class).
⁸Availability and call quality depends on environment, network conditions, and many other factors. Actual results may vary.
⁹Requires compatible app and supported content. See g.co/pixel/spatialaudio for details. Pixel Buds Pro sold separately.
¹⁰Compared to earlier version of Smart Replies. Available on Pixel Fold, Pixel 6 and newer phones only in English in the US. See g.co/pixel/callassist for details.
¹¹Requires Google Drive app. May not work on all document defects. Available on Pixel Tablet, Pixel Fold, Pixel 5a with 5G and newer phones.
¹²Your Pixel will generally receive Feature Drops during the applicable Android update and support periods for the phone. See g.co/pixel/updates for details. Availability of some Feature Drops may vary by phone model. Phone, tablet, earbuds, and watch sold separately.

___
Follow us on social:
Google Pixel Instagram: https://www.instagram.com/googlepixel
Google Pixel TikTok: https://www.tiktok.com/@googlepixel
Google Pixel Threads: https://www.threads.net/@googlepixel
Made by Google Instagram: https://www.instagram.com/madebygoogle
Made by Google X: https://twitter.com/madebygoogle
Made by Google Facebook: https://www.facebook.com/madebygoogle

Mencher Chiang

ML Infra 一大戰場 - 分散式訓練

當氣象預報也 AI Powered

2024：On-Device AI 發展到哪？