Ha mindaz igaz, amit a c\u00e9g a k\u00e1rty\u00e1j\u00e1r\u00f3l \u00e1ll\u00edt, akkor a j\u00f6v\u0151ben nem lesz sz\u00fcks\u00e9g nagy teljes\u00edtm\u00e9ny\u0171 GPU-kra, csak ezekre az apr\u00f3 lapk\u00e1kra.<\/p>\n
A tajvani\u00a0Skymizer egy hajmereszt\u0151 bejelent\u00e9ssel \u00e9rkezett. A c\u00e9g leleplezte a saj\u00e1t, szimpla PCIe foglalatba illeszthet\u0151, AI-feladatokra sz\u00fcletett gyors\u00edt\u00f3k\u00e1rty\u00e1j\u00e1t, \u00e9s ha minden \u00edg\u00e9ret igaz, akkor mind az AMD, mind az Nvidia bajba ker\u00fclhet.<\/p>\n
A v\u00e1llalat azt \u00e1ll\u00edtja, hogy a HTX301 nev\u0171 hardvere k\u00e9pes 700 milli\u00e1rd param\u00e9terrel dolgoz\u00f3 LLM-eket futtatni egyetlen egy eszk\u00f6z\u00f6n, mind\u00f6ssze 240 Watt felhaszn\u00e1l\u00e1s\u00e1val. Mindezt r\u00e1ad\u00e1sul \u00fagy \u00e9ri el, hogy \u00f6regebb \u00e9s sokkal olcs\u00f3bb, 28 nanom\u00e9teres chipeket \u00e9s LPDDR4 \/ LPDDR5 mem\u00f3riamodulokat haszn\u00e1l (a mai modern chipek 3-4 nm-en k\u00e9sz\u00fclnek). Se HBM-re, se GDDR-ra nincs sz\u00fcks\u00e9ge.<\/p>\n
A Skymizer \u00e1ll\u00edt\u00e1sa szerint a k\u00e1rtya k\u00e9pes 30 tokent kiszolg\u00e1lni m\u00e1sodpercenk\u00e9nt, alig 0,5 TOPS-szal 100 GB\/s adat\u00e1tvitel mellett. Mindez azt jelenti, hogy jelent\u0151sen szer\u00e9nyebb energiaig\u00e9nnyel, brut\u00e1lis sebess\u00e9g mellett k\u00e9pes AI-feladatokat elv\u00e9gezni a hardver, mik\u00f6zben belef\u00e9r b\u00e1rmilyen otthoni szerverg\u00e9pbe. Elvileg b\u00e1rki levehetne egy ilyen lapot a polcr\u00f3l, beilleszthetn\u00e9 a c\u00e9ges vagy otthoni g\u00e9p\u00e9be \u00e9s \u00fagy int\u00e9ztethetn\u00e9 feladatait LLM-re \u00e9p\u00fcl\u0151 szoftverekkel, hogy nem kell online felh\u0151szolg\u00e1ltat\u00e1sokra el\u0151fizetnie.<\/p>\n
Az Nvidia \u00e9s az AMD persze k\u00e9pes a fentiekn\u00e9l j\u00f3val er\u0151sebb k\u00e1rty\u00e1kat sz\u00e1ll\u00edtani, de otthoni vagy kisebb \u00fczleti felhaszn\u00e1l\u00e1sra a Skymizer megold\u00e1sa hatalmas fegyver lehet. A f\u00fcggetlen teszteredm\u00e9nyek d\u00f6ntik majd el, hogy mekkora t\u00e9nyez\u0151v\u00e9 is v\u00e1lhat a HTX301 a piacon – felt\u00e9ve persze, hogy t\u00e9nyleg hozza azt, amit k\u00e9sz\u00edt\u0151i \u00edg\u00e9rnek.<\/p>\n","protected":false},"excerpt":{"rendered":"Ha mindaz igaz, amit a c\u00e9g a k\u00e1rty\u00e1j\u00e1r\u00f3l \u00e1ll\u00edt, akkor a j\u00f6v\u0151ben nem lesz sz\u00fcks\u00e9g nagy teljes\u00edtm\u00e9ny\u0171 GPU-kra,…\n","protected":false},"author":2,"featured_media":96548,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[282,1587,32989,44,42,40,43,41,283,5340,121,120,32990,125,122,124,123],"class_list":{"0":"post-96547","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tudomany-es-technologia","8":"tag-ai","9":"tag-amd","10":"tag-htx301","11":"tag-hu","12":"tag-hungarian","13":"tag-hungary","14":"tag-magyar","15":"tag-magyarorszag","16":"tag-mesterseges-intelligencia","17":"tag-nvidia","18":"tag-science","19":"tag-science-technology","20":"tag-skymizer","21":"tag-technologia","22":"tag-technology","23":"tag-tudomany","24":"tag-tudomany-es-technologia"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@hu\/116558022850291795","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/posts\/96547","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/comments?post=96547"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/posts\/96547\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/media\/96548"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/media?parent=96547"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/categories?post=96547"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/hu\/wp-json\/wp\/v2\/tags?post=96547"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}