Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New PnP solver Netwon PnP #3503

Open
wants to merge 1 commit into
base: 4.x
Choose a base branch
from
Open

Conversation

galgibly
Copy link

@galgibly galgibly commented Jun 4, 2023

*For reference: previous PR opencv/opencv#23536
*all code is under license of opencv
*fixed warnings in code and removed exit calls
*Documentation for better solution and tests:
https://arxiv.org/pdf/2203.02686.pdf
https://arxiv.org/abs/2203.02686

Newton-PnP: Real-time Visual Navigation for Autonomous Toy-Drones
Ibrahim Jubran, Fares Fares, Yuval Alfassi, Firas Ayoub, Dan Feldman

Link for the article with information and proof of working:

The Perspective-n-Point problem aims to estimate the relative pose between a calibrated monocular camera and a known 3D model, by aligning pairs of 2D captured image points to their corresponding 3D points in the model. We suggest an algorithm that runs on weak IoT devices in real-time but still provides provable theoretical guarantees for both running time and correctness. Existing solvers provide only one of these requirements. Our main motivation was to turn the popular DJI's Tello Drone (<90gr, <$100) into an autonomous drone that navigates in an indoor environment with no external human/laptop/sensor, by simply attaching a Raspberry PI Zero (<9gr, <$25) to it. This tiny micro-processor takes as input a real-time video from a tiny RGB camera, and runs our PnP solver on-board. Extensive experimental results, open source code, and a demonstration video are included.

  • I agree to contribute to the project under Apache 2 License.
  • To the best of my knowledge, the proposed patch is not based on a code under GPL or another license that is incompatible with OpenCV
  • The PR is proposed to the proper branch
  • There is a reference to the original bug report and related work
  • There is accuracy test, performance test and test data in opencv_extra repository, if applicable
    Patch to opencv_extra has the same branch name.
  • The feature is well documented and sample code can be built with the project CMake

@galgibly galgibly force-pushed the NewtonPnP-branch branch 5 times, most recently from 6673b3c to cea6d82 Compare June 18, 2023 14:01
@galgibly
Copy link
Author

Is someone available to merge? @vpisarev @asmorkalov

@galgibly galgibly mentioned this pull request Sep 18, 2023
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant