
Programming for Mixed Reality with Windows 10, Unity, Vuforia, and UrhoSharp
Dawid Borycki(Author)
Microsoft Press
Published on 14. November 2018
Book
Paperback/Softback
464 pages
978-1-5093-0687-9 (ISBN)
Description
Develop AI-powered apps and games for HoloLens and mixed reality headsets
This is a complete guide to programming AI-powered mixed reality apps with the Windows Mixed Reality platform. Step by step, Dawid Borycki guides you through every type of mixed reality development, from simple 2D to cutting-edge apps for Microsoft HoloLens and immersive headsets. First, you'll learn to write UWP 2D apps that adapt for any Windows 10 device, transfer camera images to machine learning services, and use mobile sensor readings to control headset content. Then, building on these skills, you'll master every facet of building cross-platform 3D apps that link augmented reality content to real objects.
Advanced Microsoft technology expert Dawid Borycki shows how to:
Set up a mixed reality development environment with all the tools you'll need, including HoloLens and Mixed Reality simulators
Write Universal Windows 2D apps for all Windows 10 devices, and adjust their views and capabilities to specific hardware
Render media streams, acquire video from world-facing cameras, and detect human faces in those images
Generate descriptions of what the user sees, and present them via text or speech
Build AI-powered voice-controlled apps with Microsoft Cognitive Services (MCS)
Master core concepts and techniques for building 3D mixed reality apps with Unity
Format 3D objects with materials to create holograms
Add interactions to holograms based on user input
Integrate HoloLens capabilities, including air gestures, spatial sound, and mapping
This is a complete guide to programming AI-powered mixed reality apps with the Windows Mixed Reality platform. Step by step, Dawid Borycki guides you through every type of mixed reality development, from simple 2D to cutting-edge apps for Microsoft HoloLens and immersive headsets. First, you'll learn to write UWP 2D apps that adapt for any Windows 10 device, transfer camera images to machine learning services, and use mobile sensor readings to control headset content. Then, building on these skills, you'll master every facet of building cross-platform 3D apps that link augmented reality content to real objects.
Advanced Microsoft technology expert Dawid Borycki shows how to:
Set up a mixed reality development environment with all the tools you'll need, including HoloLens and Mixed Reality simulators
Write Universal Windows 2D apps for all Windows 10 devices, and adjust their views and capabilities to specific hardware
Render media streams, acquire video from world-facing cameras, and detect human faces in those images
Generate descriptions of what the user sees, and present them via text or speech
Build AI-powered voice-controlled apps with Microsoft Cognitive Services (MCS)
Master core concepts and techniques for building 3D mixed reality apps with Unity
Format 3D objects with materials to create holograms
Add interactions to holograms based on user input
Integrate HoloLens capabilities, including air gestures, spatial sound, and mapping
More details
Series
Language
English
Place of publication
Boston
United States
Publishing group
Microsoft Press,U.S.
Target group
Professional and scholarly
Dimensions
Height: 229 mm
Width: 189 mm
Thickness: 33 mm
Weight
798 gr
ISBN-13
978-1-5093-0687-9 (9781509306879)
Copyright in bibliographic data and cover images is held by Nielsen Book Services Limited or by the publishers or by their respective licensors: all rights reserved.
Schweitzer Classification
Person
Dawid Borycki, is a biomedical researcher and software engineer with extensive experience in Microsoft technologies. He has executed many challenging software development projects for advanced device prototyping, including signal and image processing, control algorithms, embedded device interfacing, desktop (.NET C#), web (ASP.NET MVC), and mobile (Universal Windows Platform, Xamarin, Xamarin.Forms) programming. He is author of Programming for the Internet of Things: Using Windows 10 IoT Core and Azure IoT Suite.
Content
Part I: Fundamentals
1. Introduction to Windows Mixed Reality
2. Development Tools
3. Configuring the Development Environment, Emulators and Hardware
Part II. Developing 2D UWP Apps
4. UWP Basics
5. Media Controls
6. Microsoft Cognitive Services
7. Communicating with Devices
Part III. Developing 3D Apps
8. 3D Graphics Fundamentals
9. Unity Basics
10. Physics and Scripting
11. Animations and Navigation
12. Understanding HoloLens-Specific Functionalities
13. An AI-Powered 3D App
14. Attaching Holograms to Real Objects with Vuforia
15. UrhoSharp
1. Introduction to Windows Mixed Reality
2. Development Tools
3. Configuring the Development Environment, Emulators and Hardware
Part II. Developing 2D UWP Apps
4. UWP Basics
5. Media Controls
6. Microsoft Cognitive Services
7. Communicating with Devices
Part III. Developing 3D Apps
8. 3D Graphics Fundamentals
9. Unity Basics
10. Physics and Scripting
11. Animations and Navigation
12. Understanding HoloLens-Specific Functionalities
13. An AI-Powered 3D App
14. Attaching Holograms to Real Objects with Vuforia
15. UrhoSharp