a7c137da07
* feat: Call Skia Renderer * Use default NativePreviewView for Skia * Render to separate FBO * It appears once * Refactor a lot lol * Pass width/height * Read width/heights * Update SkiaRenderer.cpp * Read stencil/samples * Use switch for target * Clear full red * Update VideoPipeline.cpp * fix: Use `BorrowTextureFrom` instead of `AdoptTextureFrom` * Get it to work * Draw Camera Frame again (only works for first frame) * glDisable(GL_BLEND) * Use Frame Buffer again * Simplify Skia offscreen surface creation * fix: Get it to kinda work? * fix: Remove `sampler2D` shader Only the EXTERNAL_OES one kinda works * Revert "fix: Remove `sampler2D` shader" This reverts commit bf241a82f440f5a442f23a2b10329b813e7cdb3e. * Revert "fix: Get it to kinda work?" This reverts commit ea6a8784ad8dc7d05e8076591874f021b51dd84a. * fix: Use Skia for rendering * Simplify drawing code a lot * Clean up drawing loop a bit more * Some docs * Update SkiaRenderer.cpp * Surface * try to use Matrix * Use BottomLeft as a surface origin again * Get actual surface dimensions * Use 1x1 pbuffer instead * Update SkiaRenderer.cpp * Update SkiaRenderer.cpp * feat: Implement Skia Frame Processor (#1735) * feat: Implement JS Skia Frame Processor * Update SkiaRenderer.cpp * push * Create Frame from C++ * compile * Compile * Update VideoPipeline.cpp * Fix JNI local ref * Use `HardwareBuffer` for implementation * feat: Custom `Frame` implementation that uses CPU `ByteBuffer` (#1736) * feat: Implement JS Skia Frame Processor * Update SkiaRenderer.cpp * push * Create Frame from C++ * compile * Compile * Update VideoPipeline.cpp * Fix JNI local ref * Use `HardwareBuffer` for implementation * try: Try to just create a CPU based ByteBuffer * fix: Fix Java Type * fix remaining errors * try fixing FrameFactory * Use `free` * fix: Fix scene mode crash on some emulators * fix: Fix scene mode crash on some emulators * Fix getting pixels * fix: Fix buffer not being freed * Add some docs to `Frame` * Test Skia again * Use `getCurrentPresentationTime()` * Remove `FrameFactory.cpp` * Update VideoPipeline.h * Update VideoPipeline.cpp
77 lines
2.0 KiB
C++
77 lines
2.0 KiB
C++
//
|
|
// Created by Marc on 21.07.2023.
|
|
//
|
|
|
|
#pragma once
|
|
|
|
#include <jni.h>
|
|
#include <fbjni/fbjni.h>
|
|
#include <fbjni/ByteBuffer.h>
|
|
#include <android/hardware_buffer.h>
|
|
#include <android/hardware_buffer_jni.h>
|
|
#include <mutex>
|
|
|
|
namespace vision {
|
|
|
|
using namespace facebook;
|
|
|
|
class JFrame : public jni::HybridClass<JFrame> {
|
|
public:
|
|
static constexpr auto kJavaDescriptor = "Lcom/mrousavy/camera/frameprocessor/Frame;";
|
|
static void registerNatives();
|
|
static jni::local_ref<JFrame::javaobject> create(int width,
|
|
int height,
|
|
int bytesPerRow,
|
|
long timestamp,
|
|
const std::string& orientation,
|
|
bool isMirrored);
|
|
|
|
~JFrame() noexcept;
|
|
|
|
protected:
|
|
friend HybridBase;
|
|
explicit JFrame(int width,
|
|
int height,
|
|
int bytesPerRow,
|
|
long timestamp,
|
|
const std::string& orientation,
|
|
bool isMirrored);
|
|
|
|
public:
|
|
int getWidth() { return _width; }
|
|
int getHeight() { return _height; }
|
|
int getBytesPerRow() { return _bytesPerRow; }
|
|
jlong getTimestamp() { return _timestamp; }
|
|
jni::local_ref<jni::JString> getOrientation() { return jni::make_jstring(_orientation); }
|
|
bool getIsMirrored() { return _isMirrored; }
|
|
|
|
// TODO: Can this be something other than RGB?
|
|
jni::local_ref<jni::JString> getPixelFormat() { return jni::make_jstring("rgb"); }
|
|
|
|
bool getIsValid();
|
|
jni::local_ref<jni::JByteBuffer> getByteBuffer();
|
|
void incrementRefCount();
|
|
void decrementRefCount();
|
|
void close();
|
|
|
|
// Backing byte data
|
|
uint8_t* pixels = nullptr;
|
|
size_t pixelsSize = 0;
|
|
|
|
private:
|
|
// Frame info
|
|
int _width = 0;
|
|
int _height = 0;
|
|
int _bytesPerRow = 0;
|
|
long _timestamp = 0;
|
|
std::string _orientation = {};
|
|
bool _isMirrored = false;
|
|
|
|
// Ref-counting
|
|
int _refCount = 0;
|
|
bool _isClosed = false;
|
|
std::mutex _mutex;
|
|
};
|
|
|
|
} // namespace vision
|