Unity XR & AI

Runtime Ecosystem

[XR] Unity is excited to collaborate with Apple to bring familiar and powerful authoring tools for creating immersive games and apps for this new spatial computing platform, Apple Vision Pro. Your apps will get access to benefits such as pass-through and Dynamic Foveated Rendering, in addition to popular Unity features like AR Foundation and XR Interaction Toolkit.

With a deep integration between Unity’s new PolySpatial technology and visionOS, your apps can sit alongside other apps in the Shared Space. By combining Unity’s authoring and simulation capabilities with RealityKit’s managed app rendering, content created with Unity will look and feel at home.

[AI] Unity Muse is an AI platform that accelerates the creation of real-time 3D applications and experiences like video games and digital twins. The eventual goal of Muse is to enable you to create almost anything in the Unity Editor using natural input such as text prompts and sketches.
‍
‍KEYWORDS
Platform; AI; visionOS; Apple; User Interface; Interaction; Experience Design; HCI; Digital Media; Spatial Computing; XR; Responsive Environment; Product Design; Visual art;  Game Design;
‍

‍

‍

Get started with spatial creation

Unity is excited to collaborate with Apple to bring familiar and powerful authoring tools for creating immersive games and apps for this new spatial computing platform, Apple Vision Pro. Your apps will get access to benefits such as pass-through and Dynamic Foveated Rendering, in addition to popular Unity features like AR Foundation and XR Interaction Toolkit.

With a deep integration between Unity’s new PolySpatial technology and visionOS, your apps can sit alongside other apps in the Shared Space. By combining Unity’s authoring and simulation capabilities with RealityKit’s managed app rendering, content created with Unity will look and feel at home.

Apply now to be selected for Unity’s beta program for visionOS, where you can create with our tutorials, templates, and sample apps. You can bring your existing Unity-created content to reimagine your experiences or create something entirely new.

To prepare for creating games and apps for visionOS, you can:

  1. Learn more about our support for Apple Vision Pro and Unity’s PolySpatial technology in Unity’s WWDC session talks.
  2. Register your interest in joining Unity’s beta program by signing up using this form. You’ll be notified by email when participants are selected to join the beta program.
  3. In the meantime, download Unity 2022 LTS to start exploring Unity or upgrading your existing projects to the latest version. Participation in the beta program will require Unity 2022 LTS.

‍


‍

‍

Imagine more with Unity AI: Muse

Unity AI: When Created and Played, Every Game Will be Touched by AI

Muse Chat is a critical feature of the Muse platform. Using Muse Chat, you can leverage AI-based search across Unity documentation, training resources, and support content to get well-structured, accurate, and up-to-date information from Unity. Muse Chat helps you find relevant information, including working code samples, to speed up development and troubleshoot issues.

Muse Animations is another sub-application. It allows you to provide prompts for specific animation requirements, for instance, you could say “Create a Character Jump”, ” Walk”, or "Fighting” animations and this tool will do it for you.

Over the next few months, you’ll see even more features in our Muse platform, including the ability to create textures and sprites or even fully animate a character, all using natural input. This is just the beginning – Unity Muse will continuously improve to help you in the Editor and on the web.

"Muse, which is practically Generative AI inside the Unity Editor. It looks like nothing special (a mix of ChatGPT, SD, and similar services), but the fact that is integrated into the game engine editor makes it very comfortable to use."

Unity Sentis

  1. Embed neural networks in your builds
  2. It also runs nearly everywhere where Unity runs which you certainly know is nearly in most platforms
  3. It is similar to how ML-Agents runs today

‍


Yiqi, designer, technologist, artist.

about me
contact me
⇑ TOPBACK TO WORKS


Have a good day !
HOME
Contacts
WA, USA
vanyiqi@gmail.com
sirrandom
Follow
/Long dream stretches, because of you.
Copyright © 2023 Yiqi Zhao. All rights reserved. 0_0