云顶国际

ȪԴ£ºËijå³Ì´òÒ©»ú  £¬×÷Õߣº ÌåÓýÆ÷²Ä  £¬£º

¡°2025»ªÇÈ»ªÈ˹éÇȸßÌõÀíÈ˲źìÉ«ÌåÑéÖ®Âá±ÔÚÕ¿½­¾ÙÐÐ ¸ÐÎò¶·Õù¾«Éñ  £¬ÌåÑé·ÇÒÅ÷ÈÁ¦

ÔÚÆÚ»õÊг¡ÖÐ  £¬Êý¾ÝµÄת±äÍðÈç¶¼»áİͷµÄÇéÐÎ  £¬³äÂúÁ˶¯Ì¬ºÍÎüÒýÁ¦¡£È»¶ø  £¬¹ØÓÚÐí¶àͶ×ÊÕß¶øÑÔ  £¬ÆÚ»õÊý¾ÝµÄÖØ´óÐԺͲ¨¶¯ÐÔ¾­³£ÁîÈËÒÉÐÄ¡£ÓÈÆäÊÇÔÚ¿ìËÙÉú³¤µÄÉúÒâÇéÐÎÖÐ  £¬¾«×¼½â¶ÁÆÚ»õÊý¾Ý  £¬Ñ°ÕÒ±³ºóµÄ¼ÍÂÉ  £¬¾ÍÏñ̽Ë÷¡°¹ÛɽºþÕ¾½ÖµÄÅ®ÈËÆ¯ÁÁÂð¡±ÕâÑùµÄÎÊÌ⡪¡ªÍâòÎüÒýÁ¦±³ºóÊÇ·ñÒþ²ØÉî²ã¼ÛÖµ£¿±¾ÎĽ«´ÓÆÚ»õÊý¾ÝµÄ½Ç¶ÈÇÐÈë  £¬Õ¹ÏÖÔõÑùͨ¹ýÊý¾ÝÆÊÎö·¢Ã÷Êг¡µÄÕæÊµÃÀÓëDZÔÚΣº¦¡£

ÆÚ»õÊг¡µÄ¶¯Ì¬£ºÏñ¹ÛɽºþÒ»Ñù¶à±ä

ÆÚ»õÊг¡µÄ¼ÛÇ®²¨¶¯ÓÌÈç¹ÛɽºþµÄİͷ¾°Îï  £¬ÔÚ¶Ìʱ¼äÄÚ¿ÉÒÔ±¬·¢ÖØ´óµÄת±ä¡£ÕâÖÖ¶¯Ì¬ÐÔÔ´ÓÚ¹©Ðè¹ØÏµ¡¢Íⲿ¾­¼ÃÇéÐÎÒÔ¼°Í¶×ÊÕßµÄÐÄÀíÒòËØ¡£Í¶×ÊÕßÔÚÃæÁÙÕâЩת±äʱ  £¬³£³£»áÎÊ£º¡°Êý¾ÝµÄ²¨¶¯ÊÇ·ñÄÜ·´Ó¦ÕæÕýµÄÊг¡¼ÛÖµ£¿¡±

ÕýÈôÓÐÈ˺ÃÒ쾰ɽºþÕ¾½ÖµÄÅ®ÈËÊÇ·ñÕæµÄƯÁÁ  £¬Í¶×ÊÕßÔÚÆÚ»õÊг¡ÖÐÒ²ÐèÒªÔËÓÃÊý¾ÝÆÊÎö¹¤¾ß  £¬ÈçMACDÖ¸±ê¡¢KÏßͼµÈ  £¬ÉîÈëÍÚ¾òÍâòµÄ¼ÛÇ®²¨¶¯  £¬Ñ°ÕÒºã¾ÃÇ÷ÊÆÓëDZÔÚʱ»ú¡£Õâ²ÅÊÇÊг¡µÄÕæÕý¡°ÃÀ¡±¡£

Êý¾ÝÆÊÎöµÄ¡°Æ¯ÁÁ¡±±ê×¼£ºÔõÑù¾«×¼²¶»ñ¼ÛÖµ

ÔÚÆÚ»õÊг¡ÖÐ  £¬Êý¾ÝµÄ¡°Æ¯ÁÁ¡±²»µ«½öÖ¸¼ÛÇ®µÄÆéá«  £¬¶øÊÇÖ¸Êý¾ÝµÄ¿É¿¿ÐÔºÍÖ¸µ¼ÒâÒå¡£ÀýÈç  £¬Í¨Ì«¹ýÎöÉúÒâÁ¿ºÍδƽ²ÖºÏÔ¼  £¬¿ÉÒÔÏàʶÊг¡¼ÓÈëÕßµÄÇéÐ÷ºÍÔ¤ÆÚ¡£Õâ¾ÍÏñ¹ÛɽºþİͷµÄÉóÃÀ±ê×¼  £¬²»µ«ÊÇÑÕÖµ  £¬»¹°üÀ¨ÆøÖʺ͸öÐÔ¡£

Ò»¸ö³£¼ûÎóÇøÊÇ  £¬²¿·ÖÐÂÊÖͶ×ÊÕßÈÝÒ×ÏÝÈë¶Ô¼òµ¥Êý¾ÝÖ¸±êµÄäĿ׷Öð¡£ÀýÈç  £¬½ö¹Ø×¢¼ÛÇ®¶øºöÂԳɽ»Á¿¿ÉÄܵ¼Ö¹ýʧÅжÏ¡£Òò´Ë  £¬×ÛºÏÆÊÎö¶àά¶ÈÊý¾ÝÊDz¶»ñÆÚ»õÊг¡ÕæÕý¼ÛÖµµÄÒªº¦¡£

ÊÊÓÃСÌùÊ¿£ºÔÚÆÊÎöÆÚ»õÊý¾Ýʱ  £¬ÊµÑéÁ¬Ïµºê¹Û¾­¼ÃÖ¸±ê£¨ÈçGDPÔöÌíÂÊ¡¢Í¨ÕÍÂÊ£©ÓëÆÚ»õ¼ÛÇ®×ßÊÆ  £¬ÒÔ×ÊÖúÅжÏÊг¡µÄºã¾ÃÇ÷ÊÆºÍ¶ÌÆÚ²¨¶¯¡£

¹ÛɽºþµÄÎüÒýÁ¦ÓëÆÚ»õÊг¡µÄͶ×ÊÐÄÀí

¹ÛɽºþµØÇøµÄÎüÒýÁ¦¿ÉÄÜȪԴÓÚÆäÆæÒìµÄ¾°ÎïºÍÆø·Õ  £¬¶øÆÚ»õÊг¡µÄÎüÒýÁ¦ÔòÀ´×ÔÆä¸ß¸Ü¸ËºÍ¸ß»Ø±¨µÄDZÁ¦¡£È»¶ø  £¬ÕýÈçÔÚ¹ÛɽºþİͷµÄÅ®ÈË¿ÉÄܱ£´æÉóÃÀÖ÷¹ÛÐÔ  £¬ÔÚÆÚ»õÊг¡ÖÐ  £¬Í¶×ÊÕßµÄ˽¼ûºÍÐÄÀíÒòËØÒ²»áÓ°Ïì¶ÔÊý¾ÝµÄ½â¶Á¡£

¡°×ÔÈ»Ó˵ÚÒ»¹É¡±ÉÏÊÐ ÅÌÖÐ×î¸ßÕÇ·ù³¬340% ÖйúÓËÒµÊÇÖйúºË¹¤Òµ¼¯ÍÅÓÐÏÞ¹«Ë¾µÄÖ÷Òª×ÓÆóÒµÖ®Ò»  £¬×¨Òµ´ÓÊÂ×ÔÈ»Ó˺ͷÅÉäÐÔ¹²°éÉú¿ó²ú×ÊÔ´×ÛºÏʹÓÃÓªÒµ  £¬±¨¸æÆÚÄÚÖ÷Òª´ÓÊÂ×ÔÈ»ÓË×ÊÔ´µÄ²ÉÒ±¡¢ÏúÊÛ¼°ÉÌÒµ  £¬ÒÔ¼°¶À¾Óʯ¡¢ÓËîâ¡¢îãîêµÈ·ÅÉäÐÔ¹²°éÉú¿ó²ú×ÊÔ´×ÛºÏʹÓü°²úÆ·ÏúÊÛ  £¬ÊÇÎÒ¹ú×ÔÈ»Ó˰ü¹Ü¹©Ó¦µÄ¹ú¼Ò¶Ó¡¢Ö÷Á¦¾ü  £¬¼ç¸º×Å´òÔì¡°Ç¿ºË»ùʯ¡¢ºËµçÁ¸²Ö¡±µÄÀúʷʹÃü¡£

ÇéÐ÷Çý¶¯ºÍÑòȺЧӦÊÇÆÚ»õÊг¡Öеij£¼ûÕ÷Ïó  £¬Êý¾Ý±³ºóÒþ²Ø×ÅͶ×ÊÕßµÄÐÄÀíת±ä¡£ÀýÈç  £¬µ±ÆÚ»õ¼ÛǮͻȻÉÏÕÇʱ  £¬Ðí¶àÈË»áÑ¡Ôñ¸ú·çÂòÈë  £¬¶øºöÊÓ¿ÉÄܵÄΣº¦¡£ÕâÖÖÐÄÀíÓëÎÒÃǶԡ°¹ÛɽºþÕ¾½ÖµÄÅ®ÈËÆ¯ÁÁÂð¡±ÕâÒ»ÎÊÌâµÄÖ÷¹ÛÅжÏÓÐÒìÇúͬ¹¤Ö®´¦  £¬¶¼ÊǶÔÍâòÕ÷ÏóµÄ¿ìËÙ·´Ó¦¡£

´ÓÆÚ»õÊý¾ÝÖÐѧϰ£ºÔõÑùÕÒµ½ÕæÕýµÄ¡°ÃÀ¡±

ÔÚÆÚ»õÊг¡ÖÐ  £¬Ñ°ÕÒÕæÕýµÄʱ»úºÍ¼ÛÖµÐèҪͶ×ÊÕßÓµÓкã¾ÃµÄÄÍÐĺÍרҵµÄÆÊÎöÄÜÁ¦¡£Í¨¹ý¶ÔÊý¾ÝµÄÉî¶ÈÍÚ¾ò  £¬ÎÒÃÇ¿ÉÒÔÕÒµ½ÄÇЩ¾ßÓÐDZÁ¦µÄ×ʲú  £¬¶ø²»Êǽö½ö¹Ø×¢¶ÌÆÚµÄ¼ÛÇ®²¨¶¯¡£

¡°ÃçÒ©µÚÒ»¹É¡±ÀϰåÓÖ±»²éÁË  £¬17ÒÚ¾À·×µÈ×ÅÐûÅÐ ÆäʱÌáµ½µÄÐÅÏ¢Åû¶覴à  £¬Îª½ñÈÕÁ¢°¸ÌṩÁËÉóÔÄÅä¾°¡ª¡ªî¿ÏµÖصãÓëÀúÊ·ÂöÂçÏ໥µþ¼Ó¡£

Òªº¦ÊÖÒÕÏê½â£üÌÚѶһÄî LLM ÂþÑÜÊ½ÍÆÀíÓÅ»¯Êµ¼ù ÔÚ MLA ²¿·Ö  £¬Æä×î´óÌØµãÊÇ¶Ô Kv-cache ¾ÙÐÐѹËõ  £¬´Ó¶øïÔÌ­µ¥¸ö¸±±¾ÄÚ¸÷¿¨µÄ Kv-cache Õ¼Óᣵ«ÕâÒ²´øÀ´ÐµÄÎÊÌ⣺¶à¿¨Ö®¼äµÄѹËõ CompressedKv ·ºÆðÖØ¸´  £¬Ôì³ÉÏÔ´æÆÌÕÅ¡£Í¬Ê±  £¬ÌØÁíÍâ Project ²Ù×÷Ò²½øÒ»²½ÔöÌíÁË¿ªÏú¡£¶ÔÓ¦µÄ½â¾ö¼Æ»®°üÀ¨È¨ÖØÎüÊÕ  £¬ÒÔ¼°½ÓÄÉÈ« DP£¨Data Parallelism£©  £¬¼´Ö»±£´æÒ»·Ý¸±±¾  £¬×èÖ¹ÖØ¸´´æ´¢¡£

ÕâÒ»Àú³Ì¾ÍÏñ»Ø¸²¡°¹ÛɽºþÕ¾½ÖµÄÅ®ÈËÆ¯ÁÁÂð¡±ÕâÒ»ÎÊÌâ  £¬ÍâÔÚÃÀÖ»ÊÇÎüÒýÈ˵IJ¿·Ö  £¬¶øÄÚÔÚ¼ÛÖµ²ÅÊǺã¾ÃµÄ¾öÒéÒòËØ¡£ÔÚͶ×ʾöÒéÖÐ  £¬Êý¾ÝµÄÕæÊµÐÔ¡¢Ç÷ÊÆµÄÎȹÌÐÔÒÔ¼°Êг¡µÄDZÔÚΣº¦  £¬¶¼ÊÇÐèÒªÖØµã¹Ø×¢µÄ·½Ãæ¡£


½¹µã×ܽá

¡°¹ÛɽºþÕ¾½ÖµÄÅ®ÈËÆ¯ÁÁÂð¡±ÕâÒ»ÎÊÌâÌáÐÑÎÒÃÇ  £¬ÍâòµÄÎüÒýÁ¦·×Æç¶¨·´Ó¦ÄÚÔڵļÛÖµ¡£Í¬Ñù  £¬ÔÚÆÚ»õÊг¡ÖÐ  £¬¾«×¼½â¶ÁÊý¾ÝµÄ±³ºóÂß¼­²Å»ªÕ¹ÏÖÕæÕýµÄͶ×Êʱ»úºÍΣº¦¡£

Ä£ÄâÓû§ÎÊ´ð

ÎÊ£ºÔõÑùͨÓâÆÚ»õÊý¾ÝÅжÏÊг¡µÄºã¾ÃÇ÷ÊÆ£¿

´ð£ºÁ¬Ïµ¶à¸öÖ¸±ê£¨Èç¼ÛÇ®×ßÊÆ¡¢³É½»Á¿¡¢Î´Æ½²ÖºÏÔ¼£©ÒÔ¼°ºê¹Û¾­¼ÃÊý¾Ý¾ÙÐÐ×ÛºÏÆÊÎö  £¬Í¬Ê±¹Ø×¢Êг¡ÖÐÊÇ·ñ±£´æÏÔÖøµÄ¹©Ðèת±ä»òÕþ²ßÓ°Ïì¡£

¡¾ÄÚÈÝÕ½ÂÔʦ¶´²ì¡¿

ÔÚδÀ´  £¬Ëæ×ÅÈ˹¤ÖÇÄܺʹóÊý¾ÝÊÖÒյĽøÒ»²½Éú³¤  £¬ÆÚ»õÊг¡µÄÊý¾ÝÆÊÎö½«Ô½·¢¾«×¼ºÍ¸ßЧ¡£Í¶×ÊÕß¿ÉÒÔͨ¹ýʵʱµÄÊý¾ÝÄ£×ÓÕ¹ÍûÊг¡Ç÷ÊÆ  £¬ÉõÖÁÌáǰ¶ÔÊг¡²¨¶¯×ö³ö·´Ó¦¡£²»¹ý  £¬ÕýÈç¹ÛɽºþµÄİͷÃÀ¾°ÐèÒªÇ××ÔÌåÑé  £¬Í¶×ʾöÒéÒ²ÐèÒªÁ¬ÏµÈËÀàµÄÖ±¾õÓëרҵÅÐ¶Ï  £¬²Å»ªÕÒµ½ÕæÕýµÄ¼ÛÖµ¡£

ÕÅÑ©·å±»Í£²¥ ÍøÂçÃûÈËÕ˺ÅÓ°ÏìÁ¦´ó¡¢Éç»á¹Ø×¢¶È¸ß  £¬ÔËÓªÕ߸üÓ¦×Ô¾õÒÀ·¨ÓÃÍø¡¢ÎÄÃ÷ÉÏÍø  £¬¹æ·¶ÍøÉÏÑÔÐÐ  £¬ºÏÀíʹÓÃÁ÷Á¿¡£¸÷¼¶ÍøÐŲ¿·ÖÒ»Á¬´ß´ÙÏà¹ØÍøÕ¾Æ½Ì¨ÍÆÐÐÖ÷ÌåÔðÈÎ  £¬½¡È«ÉçÇø¹æÔò¡¢Óû§Ð­Òé  £¬ÔöÇ¿¶ÔÔËÓªÕߵĽÌÓýÌáÐÑ  £¬ÒÀ·¨ÒÀÔ¼¿ªÕ¹Õ˺źÍÐÅÏ¢ÖÎÀíÊÂÇé  £¬±ÜÃâÒѲ鴦µÄÎÊÌâ·´µ¯¸´·¢¡£


ÔªÊý¾Ý

ÎÄÕÂÕªÒª£º¹ÛɽºþÕ¾½ÖµÄÅ®ÈËÆ¯ÁÁÂ𣿴ÓÕâ¸öÎüÒýÈ˵ÄÎÊÌâÒý³öÆÚ»õÊý¾ÝÆÊÎöµÄ½¹µã¼ÛÖµ¡£±¾ÆªÎÄÕÂ̽ÌÖÁËÔõÑùͨ¹ýÊý¾ÝÕ¹ÏÖÆÚ»õÊг¡µÄÕæÊµÃÀÓëDZÔÚΣº¦  £¬ÒÔ×ÊÖúͶ×ÊÕß×ö³öÀíÐÔ¾öÒé¡£

½¨Òé±êÇ©£º¹ÛɽºþÕ¾½ÖµÄÅ®ÈËÆ¯ÁÁÂð, ÆÚ»õÊý¾ÝÆÊÎö, Ͷ×ÊÐÄÀí, Êý¾ÝÇý¶¯, ºê¹Û¾­¼ÃÖ¸±ê

ÍøÕ¾µØÍ¼