The pre-production version of HoloLens, the Development Edition, shipped on March 30, 2016, and is targeted to developers in the United States and Canada for a list price ofUS$3,000,[4][5] which allowed hobbyist, professionals and corporations to participate in the pre-production version of HoloLens.[6]Samsung andAsus have extended an offer to Microsoft to help produce their own mixed-reality products, in collaboration with Microsoft, based around the concept and hardware on HoloLens.[7][8] On October 12, 2016, Microsoft announced global expansion of HoloLens and publicized that HoloLens would be available for preorder in Australia, Ireland, France, Germany, New Zealand and the United Kingdom.[9] There is also a commercial suite (similar to a pro edition of Windows), with enterprise features such as BitLocker security. As of May 2017, the suite sold forUS$5,000.[2] Microsoft has decided to rent the Hololens without clients making the full investment. Microsoft partners with a company called Absorbents to give the service of HoloLens rental.[10]
The HoloLens is ahead-mounted display unit connected to an adjustable, cushioned inner headband, which can tilt HoloLens up and down, as well as forward and backward.[14] To wear the unit, the user fits the HoloLens on their head, using an adjustment wheel at the back of the headband to secure it around the crown, supporting and distributing the weight of the unit equally for comfort,[15] before tilting the visor towards the front of the eyes.[14]
The front of the unit houses many of the sensors and related hardware, including the processors, cameras and projection lenses. The visor is tinted;[15] enclosed in the visor piece is a pair of transparentcombiner lenses, in which the projected images are displayed in the lower half.[16] The HoloLens must be calibrated to theinterpupillary distance (IPD) or accustomed vision of the user.[17][18]
Along the bottom edges of the side, located near the user's ears, are a pair of small, red3D audio speakers. The speakers, competing against typical sound systems, do not obstruct external sounds, allowing the user to hear virtual sounds, along with the environment.[15] Usinghead-related transfer functions, the HoloLens generatesbinaural audio, which can simulate spatial effects; meaning the user, virtually, can perceive and locate a sound, as though it is coming from a virtual pinpoint or location.[19][20][note 1]
On the top edge are two pairs of buttons: display brightness buttons above the left ear and volume buttons above the right ear.[21] Adjacent buttons are shaped differently—one concave, one convex—so that the user can distinguish them by touch.[14]
At the end of the left arm is a power button and row of five, small individual LED nodes, used to indicate system status, as well as forpower management, indicating battery level and setting power/standby mode.[14] AUSB 2.0micro-B receptacle is located along the bottom edge.[15] A 3.5mmaudio jack is located along the bottom edge of the right arm.[5][15]
The HoloLens is a first generationAR device. The displays on the HoloLens are simplewaveguide displays with a fixed focus of approximately two meters. Because of the fixed focus, the displays exhibit theVergence-Accommodation Conflict.[22]
In addition to anIntelCherry TrailSoC containing theCPU andGPU,[25] HoloLens features a custom-made Microsoft Holographic Processing Unit (HPU),[5] acoprocessor manufactured specifically for the HoloLens by Microsoft. The SoC and the HPU each have 1GBLPDDR3 and share 8MBSRAM, with the SoC also controlling 64GBeMMC and running theWindows 10operating system. The HPU uses 28 customDSPs fromTensilica[26] to process and integrate data from the sensors, as well as handling tasks such as spatial mapping,gesture recognition andvoice andspeech recognition.[16][20] According toAlex Kipman, the HPU processes "terabytes of information." One attendee estimated that the display field of view of the demonstration units was 30°×17.5°.[27] In an interview at the2015 Electronic Entertainment Expo in June, Microsoft Vice-President of Next-Gen Experiences, Kudo Tsunoda, indicated that the field of view is unlikely to be significantly different on release of the current version.[28]
The HoloLens contains an internal rechargeable battery, with average life rated at 2–3 hours of active use, or 2 weeks of standby time. The HoloLens can be operated while charging.[5]
HoloLens featuresIEEE 802.11acWi-Fi andBluetooth 4.1Low Energy (LE) wireless connectivity. The headset uses Bluetooth LE to pair with the included Clicker, a thumb-sized finger-operatinginput device that can be used for interfacescrolling and selecting. The Clicker features a clickable surface for selecting and anorientation sensor, which provides for scrolling functions via tilting and panning of the unit. The Clicker features an elastic finger loop for holding the device and a USB 2.0 micro-B receptacle for charging its internal battery.[29]
The HoloLens core display has been integrated intohard hat hardware systems.[30]
Since 2016, a number of augmented-reality applications have been showcased for the HoloLens. Some of the applications that were available at launch included:
Holograms, a catalog of a variety of 3D objects that users can place and scale around them; ranging from tigers and cats to space shuttles and planets.
HoloStudio, a full-scale 3D modeling application by Microsoft with 3D print compatibility.[31][32]
CAE VimedixAR is a commercial application of Microsoft HoloLens technology that enables immersive simulation-based training in ultrasound and anatomical education through augmented reality for increased patient safety and enhanced learning.[32][33]
An implementation of theSkype telecommunications application by Microsoft. Any user with Skype on his or her regular devices like PC, Mobile etc. can dial user on HoloLens and communicate with each other. With Video call On, the user on PC will see the view HoloLens user is seeing and HoloLens user will see view captured by PC / Mobile device user camera.[32][34]
RoboRaid (previously code-named "Project X-Ray"), an augmented-realityfirst-person shooter game by Microsoft in which the player defends against a robot invasion, aiming the weapon via gaze and shooting via the Clicker button or an air tap.[39][40]
Actiongram, an application for staging and recording short video clips of simple mixed-reality presentations using pre-made 3D virtual assets,[36] will be released in summer 2016 in the United States and Canada.[32][41]
In November, 2018,Microsoft announced that it is readying HoloLens for combat. The company won a $480 million military contract with the U.S. government to bring AR headset tech into the weapons repertoire of American soldiers.[42]
In April, 2018, novel cardiac surgery was performed at theJagiellonian University Hospital in Krakow using HoloLens imaging.[43] In April, 2021, an augmented reality laboratory was opened at theJagiellonian University Medical College with the goal of implementing the HoloLens 2 in the medical imaginary education.[44]
Other applications announced or showcased for HoloLens include:
OnSight andSidekick, software projects developed by a collaboration between NASA and Microsoft to explore mixed reality applications in space exploration[52][non-primary source needed] Developed in collaboration with JPL, OnSight integrates data from theCuriosity rover into a 3D simulation of the Martian environment,[53] which scientists around the world can visualize, interact with and collaborate in together using HoloLens devices. OnSight can be used in mission planning, with users able to program rover activities by looking at a target within the simulation and using gestures to pull up and select menu commands.[54] JPL plans to deploy OnSight inCuriosity mission operations, using it to control rover activities by July 2015.[55][needs update][non-primary source needed]
In November 2015, Volvo and Microsoft exhibited a prototype version of the HoloLens system at Microsoft's HQ in Redmond using the S90 luxury sedan as their subject.[60]
CAE VimedixAR, the first ultrasound training simulator integrated with HoloLens that allows healthcare learners to interact with 3D holograms of internal human structures and acquire proficiency in anatomy.[61]
Holoportation, a new type of3D capture technology that allows high-quality 3D models of people to bereconstructed, compressed and transmitted anywhere in the world in real time. When combined with mixed reality displays such as Hololens, this technology allows user to see and hear remote participants in 3D as if they are actually present in the same physical space.[62]
HoloSurg, in April 2017, a team of surgeons in Spain, used themixed reality tool to operate on a patient with a malignant muscular tumor, using the headset to visualize MRI and radiography information during the surgery.[63]
University education for medical and science students within disciplines that benefit from 3D representations of models, such as physiology,[65] anatomy[66] and pathology.[67]
Dawn Chorus by artist Sarah Meyohas. A mixed reality experience combining digitally rendered birds and algorithmic musical arrangement, Dawn Chorus merges HoloLens technologies with theYamaha Disklavier piano.[68]
The HoloLens uses voice commands, gaze, hand gestures and a controller as the primary input methods.[69] Gaze commands, such as head-tracking, allows the user to bring application focus to whatever the user is perceiving.[70] "Elements"—or any virtual application or button—are selected using an air tap method, similar to clicking an imaginarycomputer mouse. The tap can be held for a drag simulation to move an element, as well asvoice commands for certain commands and actions.
The HoloLensshell carries over and adapts many elements from the Windowsdesktop environment. A "bloom" gesture for accessing the shell (performing a similar function to pressing aWindows key on a Windows keyboard, tablet or the Xbox button on anXbox One Controller) is performed by opening one's hand, fingers spread with the palm facing up.[71][72] Windows can be dragged to a particular position, as well as resized. Virtual elements such as windows or menus can be "pinned" to locations, physical structures or objects within the environment; or can be "carried" or fixed in relation to the user, following the user as they move around.[73]Title bars forapplication windows have a title on the left and buttons forwindow management functions on the right.
In April 2016 Microsoft created the Microsoft HoloLens App for Windows 10 PCs andWindows 10 Mobile devices. The app allows developers to run apps on the HoloLens, use cell phone or computer keyboards for text input, view streamed video from the HoloLens on an external device and remotely capture mixed reality photos and videos.
Microsoft Visual Studio is anIDE that can be used to develop applications (both 2D and 3D) for HoloLens. Applications can be tested using HoloLens emulator (included into Visual Studio 2015 IDE) or HoloLens Development Edition.
HoloLens can run almost allUniversal Windows Platform apps.[74] These apps appear as 2D projections. Not all Windows 10 APIs are currently supported by HoloLens,[75] but in most cases the same app is able to run across all Windows 10 devices (including HoloLens), and the same tools that are used to develop applications for Windows PC or Windows Phone can be used to develop a HoloLens app.
3D applications, or "holographic" applications, use Windows Holographic APIs. Microsoft recommendsUnity engine andVuforia to create 3D apps for HoloLens, but it's also possible for a developer to build their own engine usingDirectX andWindows APIs.[76]
In November 2018 Microsoft got a contract for the supply of 100,000 HoloLens MR glasses, worth $479 million, to the U.S. military.[77] The MR goggles are intended to provide "increased lethality, mobility and situational awareness necessary to achieve overmatch against [...] current and future adversaries." Just before the opening of one of the largest international technology conferences—theGSMA Mobile World Congress 2019 in Barcelona—fifty Microsoft employees wrote a letter to theirCEOSatya Nadella and PresidentBrad Smith stating that they "refuse to develop technologies for warfare and oppression." They demanded that corporate management terminate the contract.[78]
^abcde"Introducing the Microsoft HoloLens Development Edition". Microsoft. RetrievedOctober 7, 2015.We will work to get devices out as quickly as possible. As soon as additional devices are available, more accepted applicants will be invited to purchase.
^abcdDavies, Chris (May 1, 2015)."HoloLens hands-on: Building for Windows Holographic".SlashGear. RetrievedMay 1, 2015.That means very little pressure on your nose, and even if you're wearing glasses you can generally find a workable way to keep them on underneath.
^abAlex Kipman, Seth Juarez (April 30, 2015).Developing for HoloLens. Microsoft. Event occurs at 00:07:15. RetrievedMay 1, 2015.HoloLens is the first—and so far—only holographic computer out there. [...] I hope that in the not-so-distant future there will be many such devices. [...] This is running Windows 10. All of the APIs for human and environment understanding are part of Windows, and this version of Windows that we put on this device—we call it Windows Holographic.
^Hollister, Sean (January 21, 2015)."Microsoft HoloLens Hands-On: Incredible, Amazing, Prototype-y as Hell". RetrievedMay 1, 2015.One Microsoft employee [...] typed my IPD (interpupillary distance) into a connected PC. Microsoft says the final version will automatically measure the distnace [sic] between your eyes, but the prototypes don't have that feature yet.
^abcHolmdahl, Todd (April 30, 2015)."BUILD 2015: A closer look at the Microsoft HoloLens hardware".Microsoft Devices Blog. RetrievedFebruary 29, 2016.This custom silicon efficiently processes data from the sensors, resulting in a relatively simple yet informative output that can be easily used by developers so they can focus on creating amazing experiences without having to work through complex physics calculations.
^Kreylos, Oliver (May 1, 2015)."On the road for VR: Microsoft HoloLens at Build 2015, San Francisco".Doc-Ok.org. Archived fromthe original on April 14, 2016. RetrievedJune 17, 2015.As I was stripped of all devices and gadgets before being allowed into the demo room, I had to guesstimeasure it by covering the visible screen with my hands (fingers splayed) at arm's length, ending up with 1 3/4 hands horizontally, and 1 hand vertically (in other words, a 16:9 screen aspect ratio) (see Figure 1). In non-Doc-Ok units, that comes out to about 30° by 17.5° (for comparison, the Oculus Rift DK2′s field of view is about 100° by 100°).
^Jeff Gerstmann,Phil Spencer, Kudo Tsunoda (June 16, 2015).Giant Bomb LIVE! at E3 2015: Day 01. Event occurs at 3:13:06. RetrievedJuly 4, 2015.the hardware we have now [...] the field of view isn't exactly final, but I wouldn't say it's going to be [...] hugely, noticeably different, either.
^Jeff Norris (February 10, 2016).Vision Summit 2016 Keynote. Ray Dolby Ballroom, Dolby Theatre: Unity Technologies. Event occurs at 57:26. RetrievedFebruary 17, 2016.It's a new application under development in my lab, and we're talking about it publicly for the first time today. It's a tool for spacecraft designers, and it borrows a lot of technology from the work that we're doing for our applications on the International Space Station.
^Hempel, Jessi (January 21, 2015)."Restart: Microsoft in the age of Satya Nadella". Wired. RetrievedJanuary 22, 2015.Each lens has three layers of glass—in blue, green, and red—full of microthin corrugated grooves that diffract light. [...] A "light engine" above the lenses projects light into the glasses, where it hits the grating and then volleys between the layers of glass millions of times.
^"Gestures".Windows Dev Center. RetrievedMarch 7, 2016.
