Apple wins patent for a scene camera system for a mixed reality headset that includes a 2D array of cameras

Immediately, the US Patent and Trademark Workplace has formally granted Apple a patent for a brand new HMD digital camera system that features a two-dimensional array of cameras that take footage of particular components of a scene.

Immediately, the US Patent and Trademark Workplace has formally granted Apple a patent for a brand new HMD digital camera system that features a two-dimensional array of cameras that take footage of particular components of a scene.

The cameras are positioned alongside a spherical floor in order that the cameras have adjoining fields of view. The cameras’ entrance pupils are positioned at or close to the person’s eye whereas the cameras additionally type enhanced photographs on the sensor. Strategies for lowering the variety of cameras within the matrix are additionally described, in addition to strategies for lowering the variety of pixels learn from the matrix and processed by the pipeline.

Whereas right now’s patent report may be appreciated by all Apple followers, the patent will probably be particularly appreciated by the engineers, optics engineers, and technologists who go in spite of everything issues VR headsets.

Simulated environments for digital actuality techniques and/or combined environments for combined actuality techniques can be utilized to supply an interactive person expertise for a number of functions, comparable to functions that add digital content material to a real-time view of a viewer’s setting, functions that create 3D digital worlds (Metaverse), and work together with environments Digital coaching, video games, distant management of drones or different mechanical techniques, show of digital media content material, interplay with the Web, exploration of landscapes or digital environments, or the like.

Apple’s patent covers scene cameras for video head-mounted shows (HMDs) that can be utilized in combined actuality (MR) or digital actuality (VR) techniques.

On conventional HMDs, a number of sight cameras may be mounted to the entrance of the HMD. Nevertheless, the viewpoint (POV) of scene cameras is tremendously compensated for and differs from the POV of the person’s eyes. Apple’s invention corrects the viewpoint (POV) of cameras to match the person’s POV by shifting the cameras’ entrance pupils towards the person’s eyes.

In some fashions, the HMD contains two-dimensional arrays of small type issue cameras (for instance, one matrix for the left eye, a second matrix for the proper eye) that seize photographs of particular components of a scene from the actual world in entrance of the person. The cameras are positioned alongside a curve or spherical floor in order that the cameras have non-overlapping, contiguous fields of view (FOVs).

To attain a extra correct illustration of the person’s perspective, the cameras’ optics are configured in order that the cameras’ entrance pupils are positioned within the matrix behind the cameras’ picture planes shaped on the picture sensors, and at or close to the person. the attention whereas the cameras additionally compose enhanced photographs on the sensor. On this means, every set of cameras seize views of the scene from the identical perspective because the person’s eye.

In some fashions, one sensor can be utilized to take footage of a number of cameras (for instance, 4) within the matrix. In these fashions, the optics of cameras used with a sensor may be shifted or modified to align picture planes with the sensor floor.

In some embodiments, a curved sensor and easier lens system can be utilized to supply a wider area of view for every digital camera and thus scale back the variety of cameras within the array.

Apple FIG patent. Determine 1a beneath reveals a head-mounted monitor (HMD) that features an array of cameras with entrance pupils at or close to the person’s eye; Figs. 2 reveals a part of the digital camera matrix.

Apple FIG patent. Determine 3 beneath reveals an instance of a digital camera with an entrance pupil at or close to the person’s eye that can be utilized in a matrix as proven within the figures. 1a and a pair of.

(Click on on the picture beneath to enlarge)

3 fig.  3 patents for hmd camera

Fig apple. 9A and 9B beneath display lowering the variety of cameras by lowering decision and shifting the enter pupil of the cameras into the peripheral areas.

4 Apple HMD Patent Camera 9A B 16 17

Apple FIG patent. Determine 16 above graphically reveals the addition of a passive meniscus lens in entrance of the digital camera meeting to extend the sphere of view (FOV) for perimeter cameras; Figs. Determine 17 graphically illustrates the addition of a damaging meniscus lens in entrance of the digital camera array to progressively compensate the cameras’ view in direction of the periphery.

Fig Apple patented. 20A to 20C beneath graphically illustrates an instance of a scene digital camera that features a damaging meniscus lens in entrance of the cameras within the digital camera meeting.

5 Apple Tin Patent 20A BC HMD Camera System

For extra particulars, see Apple patent 11,448,886.

Few of the inventors of Apple

Dan Henigan: Optical Mechanical Engineering Supervisor

Saito Kenichi: Optical Engineer (beforehand at Canon and Fuji Picture Movie)

Brett Miller: Digital camera Incubator Engineering Supervisor

Noah Bedard: Prototyping Engineer

Kathryn Berkner: Senior Engineering Supervisor – Digital camera Incubator

10.52FX - Stripe Patent Granted