Hands-On Unity Application Development: Unlock the power of Unity3D for non-gaming applications (English Edition)

By Puneet Singh Rawat

"Hands-On Unity Application Development" is a comprehensive guide to navigating a successful career in the rapidly-evolving world of emerging technology. Whether you are a beginner or an experienced Unity developer, this book will help you to create cutting-edge AR and AI applications.

Authored by an experienced IT expert, this book provides insights and practical advice on how to explore and capitalize on the opportunities within the field. The book starts by exploring the fundamentals of Unity, providing you with the knowledge and skills you need to get started. It then teaches you how to create 360 experiences for mobile, object tracking with photogrammetry, and how to combine physical with digital elements. The book also covers AR Foundation, empowering you to design captivating and interactive AR experiences. Furthermore, it explores AI technologies such as OpenAI and Google Vision AI, demonstrating how to seamlessly integrate them into your Unity projects to enhance interactivity and intelligence. Additionally, the book offers guidance on how to network your Unity applications, allowing for seamless communication and collaboration between devices. It also covers the creation of multi-screen experiences, enabling you to design immersive and engaging applications that span across multiple screens. Apart from theoretical knowledge, the book places a strong emphasis on practical application and provides numerous examples of how to apply Unity skills to real-world projects.

By the end of this book, you will be able to create groundbreaking AR and AI applications with ease.

• Language: English
• Publisher: BPB Online LLP
• Release date: May 8, 2023
• ISBN: 9789355518408

Book preview

CHAPTER 1

Tap into the Multi-billion-Dollar Industry

If you are reading this, you are serious about building a career with Unity. There is no better platform for developing meaningful real-world applications.

In this chapter, we will learn about what are real-world applications, go through various case studies from different industries, and look at how they are using these emerging technologies to grow their multi-billion-dollar businesses.

After reading this chapter, you will have clarity on some of the most popular buzzwords and learn about their use cases in the real market. You will have your foundation set for detailed, in-depth chapters to come.

You will have a better understanding of how industries all around you are using new innovative technology and coming up with marketing ideas to wow their customers.

Structure

In this chapter, we will cover the following topics:

Unity, I choose you.

What is a real-world application?

Ease of creation: mobile applications

Lead the XR revolution

What is Augmented Reality?

What is Virtual Reality?

What are 360 experiences?

What is computer vision?

The impact of COVID-19

Objectives

After reading this chapter, you will have clarity on some of the most popular buzzwords and learn about their use cases in the real market. You will have your foundation set for detailed, in-depth chapters to come.

You will have a better understanding of how industries all around you are using new innovative technology and coming up with marketing ideas to wow their customers.

Unity, I choose you

Unity was solely responsible for revolutionizing game development by making its game engine free for all. Once again, Unity is revolutionizing application development by making it even more accessible than ever to create immersive experiences. Also, with the rise of opportunities in AR and VR, there is no better time to jump in and be at the forefront of this revolution.

Gone are the days when Unity was used just for game development. Since its launch, it has come a long way, and now it is more ready than ever with all the crucial tools required for non-game application development, whether it be for Android, iOS, or Desktop.

A common question that pops into one’s head is, why Unity? Why not develop it natively? To answer simply—Unity has the best build and packaging support, which makes it possible to deploy on more than 15 most popular platforms with a single codebase.

Let us discuss in detail the reasons why Unity has the upper hand:

The majority of third-party SDKs are all Unity first. If they are anywhere near the release phase, you bet they have a Unity Extension ready at launch.

The Community is super helpful around Unity Forums and has probably already solved all the issues you are ever going to face in getting started with your Unity Journey.

Multi-platform: Reach the widest audience with minimal additional porting work. Deploy across all major AR, VR, mobile, desktop, console, wearables, Web, and TV platforms to captivate audiences across platforms such as mobile (android/iOS), Windows, Mac, PlayStation VR, Oculus, Microsoft HoloLens, Magic Leap, Windows Mixed Reality, and more.

Developer friendly: Unity supports c# rather than Java, which is considered to be a little simpler and more beginner-friendly.

Are you new to Unity? Do not worry; we will walk through the basics:

How to set up the Unity development environment

Learn about the Unity interface and understand its various features

Essential shortcuts and basic functions

What is a real-world application

Real-world application means an application that solves a real-world problem, whether it is enhancing convenience, driving sales, interactive marketing for a product or service, using education tools for learning, or training. It continually engages and immerses a person in the experience.

Case study in the retail industry

A really good example of a real-world application is IKEA Place, which is made for one of the most Iconic Swedish furnishings and home adornment brands, IKEA, and is used for Augmented Reality Furnishing. Shown in figure 1.1 is an example of how an Augmented Reality application looks on an iPad:

Figure 1.1: Augmented item in the real space before purchasing

The problem it solves

Spark ideas to make better-personalized choices from the comfort of your home. The application consequently scales items, given room measurements. Permits clients to picture the furniture in their homes before settling on the purchase decision.

How it works

IKEA place essentially lets you visualize furniture in your home or office setting by simply tapping and placing the furniture using your mobile. You can also swipe through various available textures on different offerings, such as sofas, chairs, and so on, and see what color or texture matches your space. Using the latest AR innovation, it is easier than ever to experience IKEA’s smart home solutions.

The technology used

ARKit and ARCore are being used for iOS and Android, and respectively, both are used to the same effect to detect the ground plane and augment the 3D model of the furniture on top of it.

Ease of creation: mobile applications

Unity empowers you to make staggering, performant, and adaptable mobile experiences effortlessly and straightforwardly. With Unity’s Canvas UI, you can rapidly create responsive interfaces for mobile applications.

At any point when you are making content for cell phones, you need to test and change your project to ensure it works with an immense assortment of devices. Getting a feeling of how your project will run on every available device is a tedious task. With features like Device Simulator built inside Unity, it is easier than ever. It cuts down your building, deploying, and testing workflow by a significant amount. Check figure 1.2:

Figure 1.2: Unity Mobile Simulator Tab

It lets you see the experience you are making right in Unity Editor itself. With the Device Simulator, you no longer need to build, deploy and run to see if it is working as expected and how your experience will look on your targeted cell phones or tablet.

Availability

Compatible with Unity 2019.3 or above.

Possibility

With Unity, you are no longer restricted to creating only games or AR experiences as mobile applications. If you wish to create a note keeper/to-do management app or a weather app, you can do so. If you wish to create a video calling application or a photo editor application, you can do that as well. The limit caps on your imagination.

Lead the XR revolution

As of 2020, 91% of Mixed Reality applications for Microsoft HoloLens are made using Unity Engine. In AR development, almost 60% of all AR projects are being made in Unity.

Regardless of whether it is VR, AR, or MR, you can rely on Unity’s exceptionally enhanced rendering pipeline and easy workflow environment to make your vision of an XR application a reality.

What is Augmented Reality?

Augmented Reality (AR) is an enhanced version of reality in which computer-generated visual data or information (such as text, images, videos, and 3D models) is overlaid on top of the real world. The majority of AR devices are handled, that is, mobile, but they are also evolving into wearables such as headsets and glasses. An exaggerated but really cool illustration of what Augmented Reality feels like is shown as follows:

Figure 1.3: Abstract representation of Augmented Reality

Case study in the fashion industry:

The Crocs LiteRide AR App lets its user explore the Crocs’ new shoe line, LiteRide, using an intuitive AR app.

The problem it solves:

The Crocs LiteRide AR app was created specifically to hype the Crocs LiteRide product. The app makes innovative use of 3D visualization in marketing the product and driving sales.

How it works:

The AR application uses a shoebox as an AR tracker, as shown in figure 1.3. A Crocs customer can point their smartphone camera at the box, which triggers visual overlays of information about the Crocs contained within.

The technology used:

Image tracking with 3D model augmentation

What is Virtual Reality?

Virtual Reality (VR) is an experience that creates a sense of fake reality that makes you believe you are in a different space altogether. There are numerous uses of Virtual Reality aside from the most widely recognized ones, like computer games, that can incorporate amusement (like watching immersive 360 movies), experiential (like shopping), and educational purposes (that is, medical or military training).

Case study in the aviation industry

To help advertise the lavish features of All Nippon Airways (ANA), Mbryonic worked with Acumen to make a virtual reality simulation visit through "The Room," ANA’s new business class cabin. Check figure 1.4:

Figure 1.4: Kid experiencing VR technology for the first time

The problem it solves:

Not every person can fly excursions to experience the new cabin components. Letting people experience highlights of the seating through VR is faster, more viable, and, above all, memorable. This is a very innovative and practical marketing tool for ANA.

How it works:

Clients wearing the headset are transported to ANA’s modern holodeck right in front of a 777 airplane. They are then shipped into the business class lodge, where they can experience the new seat’s highlights.

Not like a video, this is a fully immersive experience where users are given the option to check out the virtual cabin and interact with the surroundings with their hands. The experience empowers the headset-wearers to open and close lodge entryways, request food, change lighting conditions, and watch an inflight film.

The technology used:

After receiving 3D assets from Acumen’s design teams and Mbryonic optimized the models and textures to run at a smooth 90 frames a second inside Unity Engine. And finally built and ran the VR application on an off-the-shelf gaming laptop and Oculus Rift S VR headset.

Adopting a new medium like VR allowed ANA’s target audience to experience and understand the features of ANA’s world-class luxury cabin without really taking them onto a B777 airplane, making it extremely helpful and more practical. The vivid innovation rejuvenates the client experience and causes it to feel like you are truly there, providing memorable engagement.

What are 360 experiences

A 360-degree VR is simply a subset of Virtual Reality. Usually, the term is used for 360 video content showcasing real-world scenarios shot using 360 cameras instead of virtual 3D environments. A 360 VR experience allows users to look around them in all directions, just as they do in real life.

Case study in the media and entertainment industry:

Within VR application made by Within Team presents a platform to see astounding content from 360 filmmakers all over the world, from insane on-rail dream rides to music videos. New video experiences are included regularly, including a 13-minute, 360-degree video based on the hit TV show Mr. Robot. Check figure 1.5:

Figure 1.5: 360 images of Budapest (Tiny planet Representation)

The problem it solves:

Its primary motive is to entertain and educate you in the most immersive manner possible.

How it works:

Video recordings where a view in all six directions (Up, Down, Left, Right, Forward, and Backwards) is recorded simultaneously, using an omnidirectional camera like Insta360 or by an assortment of multiple single directional cameras are known as 360-degree videos.

The technology used:

Within VR application is available on every single notable headset, including Sony PlayStation VR, Oculus Quest, Oculus Rift, HTC Vive, Google Daydream, and Samsung Gear VR is accessible on Google Play, iOS App Store, Oculus, and the Steam Store.

What is computer vision

Computer vision is a field of Artificial Intelligence (AI) that trains PCs to decipher and comprehend the visual world. Using digital pictures from cameras, video recordings, and deep learning models, machines can precisely distinguish and detect objects—and later respond to what they see.

Case study in the beauty industry:

Wanna Nails is an app that lets users try on nail polish from curated collections with real-time segmentation and recoloring.

The problem it solves:

Try on any nail polish color instantly. Shop anytime, anywhere, and easily find all types of nail polish for your manicure!

How it works:

The app lets you pick your favorite color, and then using your mobile phone’s camera lets you try on the nail polish. The app gets updated daily with new assortments. You can also click a picture and share your virtual manicure experience on social media.

The technology used:

Computer Vision and Deep Learning.

The Impact of COVID-19

The market for Augmented Reality (AR) and Virtual Reality (VR) is expected to grow by more than 100 billion USD in the next five years.

The worldwide outbreak of coronavirus will have an overall positive effect on the AR and VR industry all around in the coming future. The development of the market can be credited to the rise in the inclination to work-from-home and online shopping. With the increase in the quantity of online corporate gatherings and events through Web conferencing, AR and VR as a medium to connect and bring people closer is more required than ever, and smart entrepreneurs like you are to bridge that gap by developing applications to further improve the experience.

AR and VR technology has also become great tools in education. Check figure 1.6:

Figure 1.6: Photo of a medical education application made using Augmented Reality

Conclusion

The Adoption rates of VR and AR technology are increasing day-by-day with the drop in the price point of mobiles that are ARCore, ARKit enabled, and VR headsets like Oculus Quest. The Innovations in technology will keep on driving the demand for AR and VR applications. The use of AR will further increase in daily life with the advancement of Wearable technology. Also, the increase in accessibility of AR in Android and iOS mobiles is enabling companies in the retail sector to drive more sales and enhance customer satisfaction. Virtual try-on rooms are helping customers make precise decisions and choose the right size and color. It also encourages users to try more designs. The same benefits are associated when choosing the furniture or designs and color for your new couch. Thus, the opportunities are increasing with the growing application market of AR and VR technology in different industries, such as education, medical, retail, and training.

There are not many industries that are left untouched by emerging technologies. We have already discussed many exciting case studies of how some of the biggest brands in the market are using interactive technologies to create immersive brand experiences. There are still a lot more case studies we are going to discuss in the upcoming chapters, and not only that, we are going to break apart how these apps are made. You will be guided step by step from scratch