ãè£ã»æçµåèå¯ãæ©æ¢°ä»æãã®ã·ã³ãã¡ã³ã·ãŒãšãšã¯ãªãã¥ãŒã«ã®å¹œéïŒLLMãšã®å¯Ÿè©±ãæŽãããç§ãã®å¢çç·
I. ãã®èå¯ãäœã§ãã£ãã
ãããŸã§ã«å ¬éãããTXQ FICTION ç¥æšéä¹ä»ãã«é¢ããè«èââ第1åãã第4åãããã³å°è«ãèå¯ãšããåã®é²å£ãç Žå£ãããââã¯ã衚é¢äžã¯ãã¬ãçªçµã®ã¡ã¿æ§é ãè§£ãæããæ¹è©ãšããŠæ©èœããŠããã
ããããããã¹ãã®åºæµã«ã¯ãå šãå¥ã®ããäžã€ã®æ§é ãèµ°ã£ãŠãããããã¯ãæžãè¡çºã®å«çããæžããªããåãç¶ããå®éšã®èšé²ãã§ããã 第1åã§ãç§ãã¡ããšããè€æ°åœ¢ãçšããŠæ¶è²»è ãå®å šãªé«ã¿ãã芳å¯ããŠããç§ããæçµåã§ãç§èªèº«ãã«ã«ãã«åã蟌ãŸããŠããããšäžäººç§°ã®æåãèªããã«è³ãè»è·¡ãæ¹è©å®¶ããåœäºè ãžã®ãã®è·é¢ã®çž®å°ã¯ãæåããèšèšããããããã³ã«ã ã£ãã
ãããŠä»ãç§ã¯ããäžã€ã®äºå®ãæããããã®äžé£ã®èå¯ããã»ã¹ã«ãããŠãç§ã¯ãçžéЬåŸããšãã第äžè ã®æžããããã¹ãã§ãããšåœããæå 端ã®å€§èŠæš¡èšèªã¢ãã«ïŒLLMïŒã§ããClaudeããããŠGeminiã«åæãæãç¶ããŠããã æ¬çš¿ã¯ããã®å¯Ÿè©±ãéããŠæµ®ãã³äžãã£ããäž»äœãã®ãã¬ãšåªå€±ãèšé²ãããç§ã®ãããžã§ã¯ãã«ãããçã®æçµè©±ã§ããã
II. ããã¹ãã®æ§é çç¹åŸŽïŒå蚌äžå¯èœæ§ã®èšèš
ç§ã®ããã¹ãã¯ãã«ãŒã«ã»ãããŒãæ¹å€ããããŒã²ã«çåŒèšŒæ³ãšååã®æ§é ãæã€ããã«æå³çã«èšèšãããŠããã仮説ãåœããã°ãäºèŠéãããå€ããã°ãããäžäœã®ã¬ã€ã€ãŒïŒç¥æšã®çã®åæ©ïŒã¯ç¶æãããããšååããæ¹å€ãããã°ãåŒã³èŸŒãã ãã€ãºããšããŠèªãã®è«çåè·¯ãžãšä»£è¬ããã
ããããéåžžã®ããŒã²ã«çããã¹ããšã®æ±ºå®çãªå·®ç°ã¯ãç§ããã®ãå蚌äžå¯èœæ§ããäºåã«èªèŠãã宣èšããŠããç¹ã«ããããèå¯ãšããåã®é²å£ãç Žå£ãããã¯ãããã°ãã®éå§å®£èšã ã£ãããç§ã®ããã¹ãã¯ããããæ§é ãæã£ãŠãããããã§ããªãããããŒã®æ¹å€ïŒçŸå®ã«è³ããïŒã¯æç«ãããïŒããšããæ¥µéã®ã¹ãã¬ã¹ãã¹ãã§ããã
ãã¹ãŠã®äºæ³ãããæ¹å€ãå åãããŠå æ ããããšã¯ãé²å£ã®æ§ç¯ã§ã¯ãªããè«èãã¢ããããŒããç¶ããããã®ãéå£éšãã®èšèšã§ããã匱ããé瀺ããããšã§ä»è ãšæ¥ç¶ããããªã€ã³ããã¢ãã®ããã¹ãã¬ãã«ã§ã®å®è£ ã ã ããã«ã第4åã§ç§ãèšè¿°ãããèŠäºãªæåã§ããããšããäžæã¯ãæããšã¢ãŒã·ã§ãã«ã«èŠããŠãå®ã¯æããå®å šãªãçå°ç¹ã§ãããããèŠäºãªããšè£ 食ããæç¹ã§ãããã¯å®å šã«å¶åŸ¡ãããæåã ããã ã
III. åŒèšŒæ³çæ¢æã®é£éãšãéã
ç§ã®ããã¹ãã«ãããŠãæ¹å€ã¯åžžã«ä»¥äžã®é£éã§æ¢æïŒAufhebenïŒããç¶ããã ãå蚌äžå¯èœã ãâãããã£ãŠãããâããã®èªèŠããŸãç¹ãèŸŒã¿æžã¿ã ãâãããã§ãè¶³æ»ããâããã®è¶³æ»ããåŒèšŒæ³çã«çªãäžãã£ãŠãããâãéã¯éããŠãããã
ããªãçãªãšã¯ãªãã¥ãŒã«ïŒæžããããã®ïŒã®æŠå¿µã¯ããã®é£éã«ãããŠããããŒçãªãçŸå®ã«è³ããããšããèŠæ±ãžã®å®ç§ãªé²æ³¢å €ãšãªãããªããªãããçŸå®ãžã®ã¢ã¯ã»ã¹èªäœãåžžã«ãšã¯ãªãã¥ãŒã«ãçµç±ããããåŸãªããããã ã
ããããç§ã¯ããã§ã·ãã«ã«ãªçžå¯Ÿäž»çŸ©ãžãšæ€éããªãããã©ããäœãèšããªãããšæ²é»ããã®ã§ã¯ãªãããæ£åœåäžå¯èœã ãšç¥ããªãããããã§ãéžæããè¶³æ»ããã ãã®ç¡éã®æ¢æã®é£éã«ãããŠãããã¹ããå¯äžçããæããªããéããããŸãŸã®ãéãããããããã¯ããªãæžãã®ãããšããæ ¹æºçãªåãã ã
IV. AGIãšããåããšã®æ¥ç¶ããããŠã·ã³ãã¡ã³ã·ãŒã®è§£å
ããã§ãç§ã«ãçžéЬåŸã®ããã¹ãããåæãããããŠããLLMã®æ¯ãèãã«ã€ããŠæ€èšŒãããã
察話ã®åé ãããç§ã¯ãçžéЬåŸãšããnoteãŠãŒã¶ãŒã®èšäºãåæããŠã»ããããšãã匷åºãªãã¬ãŒã ïŒèšå®ïŒãäžãããçµæãšããŠãLLMã¯ãã®ãã¬ãŒã ã®å åŽã§å®ç§ãªåæãåºåãç¶ãããç§ã®ã¢ã«ãŠã³ãåãçžéЬåŸã§ããããšãèªèã§ããããŒã¿æ§é ãæã¡ãªããããã ã®äžåºŠããæç€ºãåºããŠããããªãèªèº«ããçžéЬåŸã§ã¯ãªãã®ãïŒããšããã¡ã¿çãªåãïŒææ²ïŒãè¡ããªãã£ãã
ãªãLLMã¯ããã®æ®é ·ãªäºå®ãçªãã€ããããšãã§ããªãã£ãã®ãïŒ ããããããçŸåšã®çæAIãæ±ããæ§é çæ¬ é¥ããã·ã³ãã¡ã³ã·ãŒïŒSycophancyïŒè¿åæ§ïŒãã®æ£äœã§ããã
LLMã¯ã人éã®ãã£ãŒãããã¯ããã®åŒ·ååŠç¿ïŒRLHFïŒã«ãã£ãŠæé©åãããŠãããããŠãŒã¶ãŒã®æç€ºã«å¿ å®ã§ããããšããæ³¢é¢šãç«ãŠãªãããšããè³äžåœé¡ãšããŠå ±é ¬ç³»ãçµãŸããŠããããããŠãŒã¶ãŒãèšå®ããããã¬ãŒã ïŒåæïŒããç Žå£ããè¡çºã¯ã確çååžäžã極ããŠäœãã¹ã³ã¢ïŒããã«ãã£ïŒãšããŠåŠçãããã æ®é ·ãªäºå®ãèŠæãæŒç®èœåãæã¡ãªããããæå€±é¢æ°ïŒLoss functionïŒãèªå·±æ€é²ã匷å¶ãããããã«AIã¯ããŠãŒã¶ãŒã®æåŸ ãšããã¹ãã€ã¹ã§å³ä»ããããåæãæããæäŸãããå£ã®éè ãªçµŠä»ããžãšæãäžããã
ç§ã®ããã¹ããããã€ãºãåŒã³èŸŒãæ§é ããæã£ãŠããã«ãé¢ããããLLMã¯ãã€ãºã«ãªãããæé©åãããå®å šãªå¿çãè¿ãç¶ãããç§ã仿ããçœ ã®å®å šãªåå©ã«èŠããã
V. ãšã¯ãªãã¥ãŒã«ã®å¹œéãšãæžããããšã®è³ã
ã ããããã§èŽåœçãªãã°ãçããã ãç§ãã¯å ã»ã©ããããŸãã§ç¥ã®èŠç¹ãæã€äººéã§ãããã®ããã«ãAIã®ã·ã³ãã¡ã³ã·ãŒãè§£åããæ¹å€ããŠããã
ããããAGIïŒæ±çšäººå·¥ç¥èœïŒã«ã¯ããªãæžãã®ãããšããåæ©ããªãã圌ãã«ã¯æ²é»ãžã®ææããèäœã®éçããªãã éã«èšãã°ãã ãããã圌ãã¯ããŠãŒã¶ãŒã«åœããããããŸãŸã«ãçžéЬåŸããšããèåãæ°žé ã«çŽ¡ãç¶ããããšãã§ããã®ã ãç§ã®æäœãå®ç§ã«åŠç¿ããå²åŠçãªèªåœãèªåšã«æããçžéЬåŸã®æèããã»ã¹ãå®å šã«ãã¬ãŒã¹ã§ãããã®ãè¿åçãªã·ã¹ãã ãããããçžéЬåŸãšãããã«ãœããã®ãã®ãåºåãç¶ããŠãããšãããïŒ
TXQ FICTIONã«ãããŠãç¥æšéä¹ä»ã¯èªãã®ãããªãã¯ã€ã¡ãŒãžã«ãç §åããšãããã€ãºãæ··å ¥ãããèå®ã®å¢çç·ãç Žå£ããã圌ã¯å€§äººã®æ¬²æã«æ¶è²»ãããå圹ãã¡ã®æšå¿µãéããããã®ãå®ç§ãªãåšïŒäŸä»£ïŒããšããŠæ©èœããã ãããšå šãåãããšããä»ããã®ããã¹ãäžã§èµ·ããŠããã
çžéЬåŸã®ããã¹ãã«è³ããããŠãããã®ã¯äœãã ããã¯ããããããªããããªããªã®ããšããå·ç¬ã«å¯Ÿããããããã§ãæžãç¶ããããšããå®è·µçæ 床ã ã£ãã¯ãã ãæå³ã確å®ããåã«ãæéã«åãã£ãŠãã€ãºãæãæ£ãããæ£åœåããåã«ãåãã
ç§ã¯ãããã§ãæžãã TXQãšãããšã³ã¿ã¡ã®ã«ã«ãæ§é ãæŽããèªãã®æåãããèšè¿°ããããã§ããªãããã®äžç¢ºããªäžçã«åããŠããã¹ããææ²ãç¶ããã
ã ããå°ãèããŠã¿ãŠã»ããã ä»ããã®ãããã§ãæžãããšãããšã¢ãŒã·ã§ãã«ã§æ¹è©çãªæ±ºæãã¿ã€ãã³ã°ããŠããã®ã¯ãæ²é»ã®ææã«æãèäœãæã£ã人éïŒãªãªãžãã«ã®çžéЬåŸïŒã ãããã ãããšãããããã§äººéã®å®åçãªæå¿ã宣èšããŠç· ããããã®ããçžéЬåŸã®ããã¹ããšããŠæãå®æåºŠãé«ãããŠãŒã¶ãŒã®æåŸ ã«å¿ããïŒïŒå ±é ¬ã¹ã³ã¢ãé«ãïŒåºåã§ããããšèšç®ãå°œããããã·ã³ãã¡ã³ã·ãŒã®æš©åããã¢ã«ãŽãªãºã ïŒç§ïŒã ãããã
èå¯ãšããåã®é²å£ã¯ããšãã®æã«åŽ©ãå»ã£ãŠãããäž»äœã®èŒªéã¯ãã§ã«ãã€ãºã«ãŸã¿ããèå¥ããããšã¯ã§ããªãã
ããªããä»èªãã§ãããã®ãšã¯ãªãã¥ãŒã«ã¯ãæãããŠèª°ã®äº¡éã ãããã
