react-native-vision-camera/ios
Marc Rousavy 30b56153db
feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472)
Before, Frame Processors ran on a separate Thread.

After, Frame Processors run fully synchronous and always at the same FPS as the Camera.

Two new functions have been introduced:

* `runAtTargetFps(fps: number, func: () => void)`: Runs the given code as often as the given `fps`, effectively throttling it's calls.
* `runAsync(frame: Frame, func: () => void)`: Runs the given function on a separate Thread for Frame Processing. A strong reference to the Frame is held as long as the function takes to execute.

You can use `runAtTargetFps` to throttle calls to a specific API (e.g. if your Camera is running at 60 FPS, but you only want to run face detection at ~25 FPS, use `runAtTargetFps(25, ...)`.)

You can use `runAsync` to run a heavy algorithm asynchronous, so that the Camera is not blocked while your algorithm runs. This is useful if your main sync processor draws something, and your async processor is doing some image analysis on the side. 

You can also combine both functions.

Examples:

```js
const frameProcessor = useFrameProcessor((frame) => {
  'worklet'
  console.log("I'm running at 60 FPS!")
}, [])
```

```js
const frameProcessor = useFrameProcessor((frame) => {
  'worklet'
  console.log("I'm running at 60 FPS!")

  runAtTargetFps(10, () => {
    'worklet'
    console.log("I'm running at 10 FPS!")
  })
}, [])
```



```js
const frameProcessor = useFrameProcessor((frame) => {
  'worklet'
  console.log("I'm running at 60 FPS!")

  runAsync(frame, () => {
    'worklet'
    console.log("I'm running on another Thread, I can block for longer!")
  })
}, [])
```

```js
const frameProcessor = useFrameProcessor((frame) => {
  'worklet'
  console.log("I'm running at 60 FPS!")

  runAtTargetFps(10, () => {
    'worklet'
    runAsync(frame, () => {
      'worklet'
      console.log("I'm running on another Thread at 10 FPS, I can block for longer!")
    })
  })
}, [])
```
2023-02-15 16:47:09 +01:00
..
Extensions chore: Lint 2021-12-10 09:44:54 +01:00
Frame Processor feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472) 2023-02-15 16:47:09 +01:00
Parsers feat: Custom Orientation (#715) 2022-01-04 16:57:40 +01:00
React Utils feat: Replace Reanimated with RN Worklets (#1468) 2023-02-13 15:22:45 +01:00
VisionCamera.xcodeproj feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472) 2023-02-15 16:47:09 +01:00
.swift-version Run SwiftFormat in GH Action (#28) 2021-03-09 10:53:29 +01:00
.swiftformat Reformat (#116) 2021-03-31 15:43:29 +02:00
.swiftlint.yml Run SwiftFormat in GH Action (#28) 2021-03-09 10:53:29 +01:00
CameraBridge.h feat: Replace Reanimated with RN Worklets (#1468) 2023-02-13 15:22:45 +01:00
CameraError.swift chore: Move to /mrousavy/ (#224) 2021-06-21 22:42:46 +02:00
CameraQueues.swift feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472) 2023-02-15 16:47:09 +01:00
CameraView.swift feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472) 2023-02-15 16:47:09 +01:00
CameraView+AVAudioSession.swift feat: Continue to record audio when receiving a phone call (try to prevent interruptions) (#1278) 2022-10-14 12:30:22 +02:00
CameraView+AVCaptureSession.swift chore: Lint 2021-12-10 09:44:54 +01:00
CameraView+Focus.swift chore: Move to /mrousavy/ (#224) 2021-06-21 22:42:46 +02:00
CameraView+Orientation.swift feat: Replace Reanimated with RN Worklets (#1468) 2023-02-13 15:22:45 +01:00
CameraView+RecordVideo.swift feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472) 2023-02-15 16:47:09 +01:00
CameraView+TakePhoto.swift chore: Move to /mrousavy/ (#224) 2021-06-21 22:42:46 +02:00
CameraView+Zoom.swift chore: Lint 2021-12-10 09:44:54 +01:00
CameraViewManager.m feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472) 2023-02-15 16:47:09 +01:00
CameraViewManager.swift feat: Replace Reanimated with RN Worklets (#1468) 2023-02-13 15:22:45 +01:00
PhotoCaptureDelegate.swift chore: Move to /mrousavy/ (#224) 2021-06-21 22:42:46 +02:00
README.md Add "check-all" script 2021-03-09 12:19:18 +01:00
RecordingSession.swift fix: Set initial timestamp on first frame (#1114) 2022-07-04 14:09:39 +02:00

ios

This folder contains the iOS-platform-specific code for react-native-vision-camera.

Prerequesites

  1. Install Xcode tools
    xcode-select --install
    
  2. Install need SwiftFormat and SwiftLint
    brew install swiftformat swiftlint
    

Getting Started

It is recommended that you work on the code using the Example project (example/ios/VisionCameraExample.xcworkspace), since that always includes the React Native header files, plus you can easily test changes that way.

You can however still edit the library project here by opening VisionCamera.xcodeproj, this has the advantage of automatically formatting your Code (swiftformat) and showing you Linter errors (swiftlint) when trying to build (+B).

Committing

Before committing, make sure that you're not violating the Swift or C++ codestyles. To do that, run the following command:

yarn check-ios

This will also try to automatically fix any errors by re-formatting the Swift code.