英特尔锐炫GPU第一时间适配Llama 3 展现卓越性能

PChome04-26

英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型，凭借英特尔锐炫显卡的强大性能，开发者能够轻松在本地运行Llama 3模型，为生成式AI工作负载提供加速。Meta此前已经发布了新一代Llama 3大语言模型，在发布后不久，英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型在英特尔AI产品组合上的运行情况。在客户端领域，测试表明凭借英特尔锐炫显卡的强大性能，...

网页链接

免责声明：本文观点仅代表作者个人观点，不构成本平台的投资建议，本平台不对文章信息准确性、完整性和及时性做出任何保证，亦不对因使用或信赖文章信息引发的任何损失承担责任。

精彩评论

我们需要你的真知灼见来填补这片空白

发表看法

{"i18n":{"language":"zh_CN"},"isChannel":false,"data":{"share":"https://www.laohu8.com/m/news/2430126085?lang=zh_CN&edition=full","thumbnail":"https://k.sinaimg.cn/n/spider20240425/296/w720h376/20240425/dfae-67b49fd991a2afef12cdfc11a2a8c360.png/w120h90l50t12aa.jpg","is_english":false,"pubTime":"2024-04-26 08:00","share_image_url":"https://static.laohu8.com/e9f99090a1c2ed51c021029395664489","id":"2430126085","market":"hk","top_or_hot":-1,"title":"英特尔锐炫GPU第一时间适配Llama 3 展现卓越性能","media":"PChome","content":"<div>\n<p>英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型，凭借英特尔锐炫显卡的强大性能，开发者能够轻松在本地运行Llama 3模型，为生成式AI工作负载提供加速。Meta此前已经发布了新一代Llama 3大语言模型，在发布后不久，英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型在英特尔AI产品组合上的运行情况。在客户端领域，测试表明凭借英特尔锐炫显卡的强大性能，...</p>\n\n<a href=\"https://tech.sina.cn/mobile/xp/2024-04-26/detail-inataefs5857632.d.html?vt=4\">网页链接</a>\n\n</div>\n","source":"sina_tech","html":"<!DOCTYPE html>\n<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\" />\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1.0,minimum-scale=1.0,maximum-scale=1.0,user-scalable=no\"/>\n<meta name=\"format-detection\" content=\"telephone=no,email=no,address=no\" />\n<title>英特尔锐炫GPU第一时间适配Llama 3 展现卓越性能</title>\n<style type=\"text/css\">\na,abbr,acronym,address,applet,article,aside,audio,b,big,blockquote,body,canvas,caption,center,cite,code,dd,del,details,dfn,div,dl,dt,\nem,embed,fieldset,figcaption,figure,footer,form,h1,h2,h3,h4,h5,h6,header,hgroup,html,i,iframe,img,ins,kbd,label,legend,li,mark,menu,nav,\nobject,ol,output,p,pre,q,ruby,s,samp,section,small,span,strike,strong,sub,summary,sup,table,tbody,td,tfoot,th,thead,time,tr,tt,u,ul,var,video{ font:inherit;margin:0;padding:0;vertical-align:baseline;border:0 }\nbody{ font-size:16px; line-height:1.5; color:#999; background:transparent; }\n.wrapper{ overflow:hidden;word-break:break-all;padding:10px; }\nh1,h2{ font-weight:normal; line-height:1.35; margin-bottom:.6em; }\nh3,h4,h5,h6{ line-height:1.35; margin-bottom:1em; }\nh1{ font-size:24px; }\nh2{ font-size:20px; }\nh3{ font-size:18px; }\nh4{ font-size:16px; }\nh5{ font-size:14px; }\nh6{ font-size:12px; }\np,ul,ol,blockquote,dl,table{ margin:1.2em 0; }\nul,ol{ margin-left:2em; }\nul{ list-style:disc; }\nol{ list-style:decimal; }\nli,li p{ margin:10px 0;}\nimg{ max-width:100%;display:block;margin:0 auto 1em; }\nblockquote{ color:#B5B2B1; border-left:3px solid #aaa; padding:1em; }\nstrong,b{font-weight:bold;}\nem,i{font-style:italic;}\ntable{ width:100%;border-collapse:collapse;border-spacing:1px;margin:1em 0;font-size:.9em; }\nth,td{ padding:5px;text-align:left;border:1px solid #aaa; }\nth{ font-weight:bold;background:#5d5d5d; }\n.symbol-link{font-weight:bold;}\n/* header{ border-bottom:1px solid #494756; } */\n.title{ margin:0 0 8px;line-height:1.3;color:#ddd; }\n.meta {color:#5e5c6d;font-size:13px;margin:0 0 .5em; }\na{text-decoration:none; color:#2a4b87;}\n.meta .head { display: inline-block; overflow: hidden}\n.head .h-thumb { width: 30px; height: 30px; margin: 0; padding: 0; border-radius: 50%; float: left;}\n.head .h-content { margin: 0; padding: 0 0 0 9px; float: left;}\n.head .h-name {font-size: 13px; color: #eee; margin: 0;}\n.head .h-time {font-size: 11px; color: #7E829C; margin: 0;line-height: 11px;}\n.small {font-size: 12.5px; display: inline-block; transform: scale(0.9); -webkit-transform: scale(0.9); transform-origin: left; -webkit-transform-origin: left;}\n.smaller {font-size: 12.5px; display: inline-block; transform: scale(0.8); -webkit-transform: scale(0.8); transform-origin: left; -webkit-transform-origin: left;}\n.bt-text {font-size: 12px;margin: 1.5em 0 0 0}\n.bt-text p {margin: 0}\n</style>\n</head>\n<body>\n<div class=\"wrapper\">\n<header>\n<h2 class=\"title\">\n英特尔锐炫GPU第一时间适配Llama 3 展现卓越性能\n</h2>\n\n<h4 class=\"meta\">\n\n\n2024-04-26 08:00 北京时间&nbsp;&nbsp;&nbsp;<a href=https://tech.sina.cn/mobile/xp/2024-04-26/detail-inataefs5857632.d.html?vt=4><strong>PChome</strong></a>\n\n\n</h4>\n\n</header>\n<article>\n<div>\n<p>英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型，凭借英特尔锐炫显卡的强大性能，开发者能够轻松在本地运行Llama 3模型，为生成式AI工作负载提供加速。Meta此前已经发布了新一代Llama 3大语言模型，在发布后不久，英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型在英特尔AI产品组合上的运行情况。在客户端领域，测试表明凭借英特尔锐炫显卡的强大性能，...</p>\n\n<a href=\"https://tech.sina.cn/mobile/xp/2024-04-26/detail-inataefs5857632.d.html?vt=4\">网页链接</a>\n\n</div>\n\n\n</article>\n</div>\n</body>\n</html>\n","isBrief":false,"type":0,"news_type":1,"symbol":"BK4141","symbol_name":"半导体产品","start_time":0,"source_url":"https://tech.sina.cn/mobile/xp/2024-04-26/detail-inataefs5857632.d.html?vt=4","article_id":"2430126085","we_media_id":null,"thumbnails":["https://k.sinaimg.cn/n/spider20240425/296/w720h376/20240425/dfae-67b49fd991a2afef12cdfc11a2a8c360.png/w120h90l50t12aa.jpg"],"rights":{"source":"sina_tech","url":"https://tech.sina.cn/mobile/xp/2024-04-26/detail-inataefs5857632.d.html?vt=4","rn_cache_url":null,"customStyle":"body{padding-top:10px;}.art_tit_h1{#titleStyle#}a{#lv2TextColor#}.art_time, .art_cite{#sourceStyle#;} .art_cite{margin-left: 3px;}.weibo_user{#sourceStyle#; margin-bottom: 0; display: inline-block;}.weibo_time{#sourceStyle#};","selectors":".module-article, article","filters":"header, .voice2, .tags, #norm_qrcode_link_auto, .unfold-box, .action, .j_float_wbro, .j_article_wbreco","directOrigin":true},"url":"https://stock-news.laohu8.com/highlight/detail?id=2430126085","pubTimestamp":1714089640,"sourceInfo":{"source_id":"sina_tech","name":"新浪科技"},"weMediaInfo":null,"summary":"Meta此前已经发布了新一代Llama 3大语言模型，在发布后不久，英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型在英特尔AI产品组合上的运行情况。在客户端领域，测试表明凭借英特尔锐炫显卡的强大性能，开发者能够轻松在本地运行Llama 3模型，为生成式AI工作负载提供加速。英特尔酷睿Ultra处理器和英特尔锐炫显卡在Llama 3模型发布的第一时间便提供了良好适配，这彰显了英特尔和Meta携手为本地AI开发和数百万设备的部署所作出的努力。","collect":0,"end_time":0,"defaultTopTitle":"sina.cn","property":[],"viewcount":null,"language":"zh","relate_stocks":{"BK4141":"半导体产品","INTC":"英特尔","BK4575":"芯片概念","BK4585":"ETF&股票定投概念","BK4512":"苹果概念","BK4527":"明星科技股","BK4529":"IDC概念","LU0321505868.SGD":"Schroder ISF Global Dividend Maximiser A Dis SGD","BK4550":"红杉资本持仓","BK4579":"人工智能","BK4535":"淡马锡持仓","BK4588":"碎股","BK4533":"AQR资本管理(全球第二大对冲基金)","LU0321505439.SGD":"Schroder ISF Global Dividend Maximiser A Acc SGD","BK4515":"5G概念","BK4554":"元宇宙及AR概念","BK4534":"瑞士信贷持仓"},"translate_title":"Intel Ruixuan GPU adapted to Llama 3 for the first time to show excellent performance","themeId":null,"isJumpTheme":false,"ttsUrl":null,"symbols_score_info":{"INTC":1},"content_text":"英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型，凭借英特尔锐炫显卡的强大性能，开发者能够轻松在本地运行Llama 3模型，为生成式AI工作负载提供加速。Meta此前已经发布了新一代Llama 3大语言模型，在发布后不久，英特尔就第一时间优化并验证了80亿和700亿参数的Llama 3模型在英特尔AI产品组合上的运行情况。在客户端领域，测试表明凭借英特尔锐炫显卡的强大性能，开发者能够轻松在本地运行Llama 3模型，为生成式AI工作负载提供加速。\n\n\n\n\n此外，英特尔酷睿Ultra H系列处理器展现出了高于普通人阅读速度的输出生成性能，而这一结果主要得益于其内置的英特尔锐炫GPU，该GPU具有8个Xe核心，以及DP4a AI加速器和高达120 GB/s的系统内存带宽。\n\n\n\n\n英特尔酷睿Ultra处理器和英特尔锐炫显卡在Llama 3模型发布的第一时间便提供了良好适配，这彰显了英特尔和Meta携手为本地AI开发和数百万设备的部署所作出的努力。英特尔客户端硬件性能的大幅提升得益于用于本地研发的PyTorch和英特尔PyTorch扩展包等丰富的软件框架与工具，以及用于模型部署和推理的OpenVINO工具包。\n\n\n\n\n而根据具体的测试样例来看，在使用IPEX-LLM库运行70亿参数的Mistral模型时，锐炫A770 16GB显卡每秒可以处理70个token（TPS），比使用CUDA的GeForce RTX 4060 8GB的TPS高出70%。英特尔内部测试表明，锐炫A770 16GB显卡在运行大模型时能够提供卓越的性能。相比RTX 4060，锐炫A770 16GB显卡在运行大多数模型时具备极有竞争力或领先的性能，这也使其成为在本地运行大语言模型的更优选择。","kind":null,"is_publish_news":null,"is_publish_highlight":null,"is_publish_live":null,"is_publish_wemedia":null,"editions":null,"symbols":[],"gpt_button":1},"commentList":[],"isCommentEnd":true,"newsSizeData":{"likeSize":0,"commentSize":0,"repostSize":0,"favoriteSize":0,"likeStatus":false,"favoriteStatus":false},"APP":{"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","isDev":false,"isTTM":false,"deviceId":"web-server-community-laohu8-v3","version":"4.22.4","shortVersion":"4.22.4","platform":"web","vendor":"web","appName":"laohu8","isIOS":false,"isAndroid":false,"isTiger":false,"isTHS":false,"isWeiXin":false,"isWeiXinMini":false,"isWeiBo":false,"isQQ":false,"isBaiduSwan":false,"isBaiduBox":false,"isDingTalk":false,"isToutiao":false,"isOnePlus":false,"isHuaWei":false,"isXiaomi":false,"isXiaomiWebView":false,"isOppo":false,"isVivo":false,"isSamsung":false,"isMobile":false},"href":"/m/news/2430126085"}