AgentHands: Google wa XR no AI agent ni monoga aru basho o shishimesu noryoku o ataeru

Genzai no AI assistant wa, sudeni camera o toshite kanari yoku miru koto ga dekimasu. Project Astra ya Gemini Live nado no tool wa shui no kankyo ni hanno deki, oku no baai, hanashite iru naiyo o kyocho suru tameni 2D no kyokai box o shiyo shimasu. Shikashi, Android XR no yona platform dewa, kono flat na UI approach dewa fujubun desu. Sonotame, Google wa, CHI 2026 conference kara, kanzenna 3D higengo communication o agent ni modosu kenkyu prototype de aru AgentHands o release shite imasu.

Kukan kankyo ni okeru flat UI no shuen

Extended Reality dewa, object no shui ni irotsuki no box wa hitsuyo arimasen. Agent ga shizen ni katachi o shimeshitari, action o teian shitari, juyona point o kyocho shitari suru hitsuyo ga arimasu. Korera wa subete, onsei to kanzen ni doki shite imasu. AgentHands wa, masani kore o okonau LLM tosai system desu. Chushotekina shiji o, kankyo-nai no meikakuna shikakuteki demonstration ni henkan shimasu.

Interakushon ga text kara butsuritekina hoko kankaku ni iko suru

Kono henka wa, 2D no kotoba o tsukatte 3D object o setsumei shiyo to suru kokoromi no owari o imi shimasu. Zairyo no setsudan o doko kara hajimeru ka, aruiwa dono port ni cable o sasu ka o seikaku ni shimesu koto ga dekiru kaso no te wa, ichibu no kogyo oyobi kyoiku scenario dewa, nagai setsumeibun ya seishiga yorimo haruka ni yakudachimasu.

Manual navigation kino o motsu agent

AR oyobi XR glasses no user ni totte, kore wa interaction no ningenkogaku o konponteki ni kaeru mono desu. Agent ni nanika o shuri suru hoho ya nanika ga aru basho o tazuneru toki, interface no overlay o decode suru hitsuyo wa mo arimasen. Kaso no te ga tokutei no neji o chokusetsu yubisasitari, sore o ugokasu tame no seikakuna gesture o shimeshitari shimasu. Google wa gesture no yomiyasusa ni juten o oki, sore ni kansuru tokutei no bunruiho (kikite, gesture, kukansei, jikanteki dynamics, interactive-sei, shikaku koka) o sakusei shimashita.

Hoko kankaku no kojo ga XR o shokuba ni motarasu

Kono approach no jikkokano-sei no shin no shoko wa, lab no demo dewanaku, fukuzatsuna kukanteki shiji ni kuro suru koto naku, open-end no task no tameni korera no doki sareta 3D layer o realtime de kakujitsu ni seisei dekiru kadoka desu. Smooth ni kino sureba, AR glasses no agent ga watashitachi no butsuritekina sekai to donoyoni tsushin suru ka ni tsuite no atarashi hyojun ni naru desho.

Lilithの判定

Bohan camera no dashboard no yona orokana akai chohokei wa mo arimasen. Kore wa, assistant ga display jo no layer dewanakunari, heya no shin no actor ni naru step desu.