John Lu
John is a Senior Machine Learning Engineer from a Top-tier company, currently focused on developing NLP applications.
He is deeply motivated by challenges and tends to be excited by breaking conventional ways of thinking and doing. With prior experiences in Software Engineering, he works on combining the latest AI technology and engineering to transform challenges into practical solutions.
Beitrag
08.08
13:30
30min
使用 PyTorch 從零量化 YOLOX
John Lu
模型量化 (Model Quantization) 能在推論階段中有效降低計算量與記憶體使用量。 透過將模型權重與輸入資料轉換為低精度資料型態，不僅能加快運算速度，還能讓模型部署在嵌入式裝置。 本次演講將示範如何以 Python 實作模型量化。我們將從零開始，使用 PyTorch 對 YOLOX 物件偵測模型進行量化，帶領大家從原理到實作，將量化技術應用於開源模型，並轉化為可落地的解決方案。
Open LLM Tech: Core Technologies
TR212