feat: Add support for new External, Continuity and LiDAR Cameras

[mrousavy]

What

This PR adds support for four new Camera Devices on iOS:

• External Cameras (On iPad, external devices are those that conform to the UVC (USB Video Class) specification)
• Continuity Cameras (e.g. your Mac's Camera streamed through AirPlay)
• True Depth Camera (a Camera device streaming both depth data (through Infrared) and colors (YUV))
• LiDAR Camera (a Camera device streaming both depth data (through a LiDAR sensor) and colors (YUV))

Blockers

Currently, a device looks like this:

{
  devices: ('wide-angle-camera' | 'ultra-wide-angle-camera' | 'telephoto-camera')[]
  position: 'front' | 'back' | 'external'
}

But the external and continuity cameras don't have the device types. They don't tell me whether they're wide-angle or ultra-wide etc., they just say they're external. Therefore I either need to add a unknown or external type to the devices, which is kinda lame as the lens information should be known (through FOV/focal length). Only the position should be external in that case.
I'll need to investigate this, but unfortunately I don't have a device to test this on. Someone wanna borrow me an iPad?

Changes

Tested on

Related issues

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated (UTC)
react-native-vision-camera	✅ Ready (Inspect)	Visit Preview	Sep 19, 2023 7:32am

[tiste]

Hello @mrousavy, I have time if you want me to test it on a real device.

[mrousavy]

Thanks @tiste !

[basememara]

Why was this closed, is LiDAR camera support still in the making or was merged somewhere else?

[jarbozhang]

I have tested the external webcam functionality on the Logitech HD Webcam C270 model, and it works normally in both the iPad FaceTime application and the Zoom application. However, in this project, specifying useCameraDevice('external') returns undefined, and using getAvailableCameraDevices only returns the two front and one back cameras of the iPad 10.

[mrousavy]

@jarbozhang you could try adding this code to CameraDevicesManager.swift in the getAllDeviceTypes() function at the bottom:

    if #available(iOS 17.0, *) {
      deviceTypes.append(.external)
      deviceTypes.append(.continuityCamera)
    }

[jarbozhang]

@jarbozhang you could try adding this code to CameraDevicesManager.swift in the getAllDeviceTypes() function at the bottom:

    if #available(iOS 17.0, *) {
      deviceTypes.append(.external)
      deviceTypes.append(.continuityCamera)
    }

Thank you very much for your response. For now, I can only fork a copy of the repo and then deploy to npm. I look forward to your updates!