react-native-vision-camera/ios
Marc Rousavy a7c137da07
feat: Skia for Android (#1731)
* feat: Call Skia Renderer

* Use default NativePreviewView for Skia

* Render to separate FBO

* It appears once

* Refactor a lot lol

* Pass width/height

* Read width/heights

* Update SkiaRenderer.cpp

* Read stencil/samples

* Use switch for target

* Clear full red

* Update VideoPipeline.cpp

* fix: Use `BorrowTextureFrom` instead of `AdoptTextureFrom`

* Get it to work

* Draw Camera Frame again (only works for first frame)

* glDisable(GL_BLEND)

* Use Frame Buffer again

* Simplify Skia offscreen surface creation

* fix: Get it to kinda work?

* fix: Remove `sampler2D` shader

Only the EXTERNAL_OES one kinda works

* Revert "fix: Remove `sampler2D` shader"

This reverts commit bf241a82f440f5a442f23a2b10329b813e7cdb3e.

* Revert "fix: Get it to kinda work?"

This reverts commit ea6a8784ad8dc7d05e8076591874f021b51dd84a.

* fix: Use Skia for rendering

* Simplify drawing code a lot

* Clean up drawing loop a bit more

* Some docs

* Update SkiaRenderer.cpp

* Surface

* try to use Matrix

* Use BottomLeft as a surface origin again

* Get actual surface dimensions

* Use 1x1 pbuffer instead

* Update SkiaRenderer.cpp

* Update SkiaRenderer.cpp

* feat: Implement Skia Frame Processor (#1735)

* feat: Implement JS Skia Frame Processor

* Update SkiaRenderer.cpp

* push

* Create Frame from C++

* compile

* Compile

* Update VideoPipeline.cpp

* Fix JNI local ref

* Use `HardwareBuffer` for implementation

* feat: Custom `Frame` implementation that uses CPU `ByteBuffer` (#1736)

* feat: Implement JS Skia Frame Processor

* Update SkiaRenderer.cpp

* push

* Create Frame from C++

* compile

* Compile

* Update VideoPipeline.cpp

* Fix JNI local ref

* Use `HardwareBuffer` for implementation

* try: Try to just create a CPU based ByteBuffer

* fix: Fix Java Type

* fix remaining errors

* try fixing FrameFactory

* Use `free`

* fix: Fix scene mode crash on some emulators

* fix: Fix scene mode crash on some emulators

* Fix getting pixels

* fix: Fix buffer not being freed

* Add some docs to `Frame`

* Test Skia again

* Use `getCurrentPresentationTime()`

* Remove `FrameFactory.cpp`

* Update VideoPipeline.h

* Update VideoPipeline.cpp
2023-09-01 10:43:19 +02:00
..
Extensions feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
Frame Processor feat: Skia for Android (#1731) 2023-09-01 10:43:19 +02:00
Parsers feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
React Utils feat: Expose unified VisionCameraProxy object, make FrameProcessorPlugins object-oriented (#1660) 2023-07-21 17:52:30 +02:00
Skia Render Layer feat: Skia for Android (#1731) 2023-09-01 10:43:19 +02:00
VisionCamera.xcodeproj feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
.swift-version Run SwiftFormat in GH Action (#28) 2021-03-09 10:53:29 +01:00
.swiftformat Reformat (#116) 2021-03-31 15:43:29 +02:00
.swiftlint.yml fix: Fix CI for V3 (#1475) 2023-02-15 17:24:33 +01:00
CameraBridge.h feat: Expose unified VisionCameraProxy object, make FrameProcessorPlugins object-oriented (#1660) 2023-07-21 17:52:30 +02:00
CameraError.swift feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
CameraQueues.swift feat: Sync Frame Processors (plus runAsync and runAtTargetFps) (#1472) 2023-02-15 16:47:09 +01:00
CameraView.swift feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
CameraView+AVAudioSession.swift feat: Complete iOS Codebase rewrite (#1647) 2023-07-20 15:30:04 +02:00
CameraView+AVCaptureSession.swift feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
CameraView+Focus.swift feat: Complete iOS Codebase rewrite (#1647) 2023-07-20 15:30:04 +02:00
CameraView+Orientation.swift feat: Draw onto Frame as if it was a Skia Canvas (#1479) 2023-02-21 15:00:48 +01:00
CameraView+Preview.swift feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
CameraView+RecordVideo.swift feat: Complete iOS Codebase rewrite (#1647) 2023-07-20 15:30:04 +02:00
CameraView+TakePhoto.swift feat: Add enableShutterSound prop to takePhoto() 🔊 (#1702) 2023-08-21 15:27:42 +02:00
CameraView+Torch.swift feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
CameraView+Zoom.swift chore: Lint 2021-12-10 09:44:54 +01:00
CameraViewManager.m fix: Export pixelFormat property on iOS 2023-08-24 17:14:24 +02:00
CameraViewManager.swift feat: Full Android rewrite (CameraX -> Camera2) (#1674) 2023-08-21 12:50:14 +02:00
NativePreviewView.swift feat: Complete iOS Codebase rewrite (#1647) 2023-07-20 15:30:04 +02:00
PhotoCaptureDelegate.swift feat: Add enableShutterSound prop to takePhoto() 🔊 (#1702) 2023-08-21 15:27:42 +02:00
PreviewView.swift feat: Complete iOS Codebase rewrite (#1647) 2023-07-20 15:30:04 +02:00
README.md Add "check-all" script 2021-03-09 12:19:18 +01:00
RecordingSession.swift fix: Set initial timestamp on first frame (#1114) 2022-07-04 14:09:39 +02:00

ios

This folder contains the iOS-platform-specific code for react-native-vision-camera.

Prerequesites

  1. Install Xcode tools
    xcode-select --install
    
  2. Install need SwiftFormat and SwiftLint
    brew install swiftformat swiftlint
    

Getting Started

It is recommended that you work on the code using the Example project (example/ios/VisionCameraExample.xcworkspace), since that always includes the React Native header files, plus you can easily test changes that way.

You can however still edit the library project here by opening VisionCamera.xcodeproj, this has the advantage of automatically formatting your Code (swiftformat) and showing you Linter errors (swiftlint) when trying to build (+B).

Committing

Before committing, make sure that you're not violating the Swift or C++ codestyles. To do that, run the following command:

yarn check-ios

This will also try to automatically fix any errors by re-formatting the Swift code.