Prophesee Introduces Metavision SDK5 PRO
Now included with USB EVK purchases
PARIS – October 7, 2024 – Since its launch in 2020, Metavision SDK has been an incredible success, establishing itself as the most comprehensive event-based software suite on the market. With 64 algorithms, 105 code samples, and 17 tutorials, it’s become the go-to toolkit for over 15,000 users worldwide and has earned 5 prestigious international awards.
Building on this momentum, we are excited to take the next step in empowering the community to achieve their vision with even greater ease.
Starting today, Metavision SDK5 PRO:
- Is included at no additional cost in both binaries and source form with every Prophesee USB EVK purchase.
- Is available for standalone purchase and more accessible than ever, allowing even more developers to turn their ideas into reality.
Join a rapidly growing global community and unlock your next breakthrough with Metavision SDK Pro: http://www.rfnf.cn/en/metavision-sdk-pro/
Contents:
NEW in Metavision SDK5.0 Pro:
- Demo stereo matching
- Stereo / N-Camera calibration app
- Active markers demo optimized for embedded platforms
- New simplified classes to iterate over events from synchronized cameras in Python and C++
- New machine learning C++ inference pipeline, enabling easy integration with LibTorch and ONNX Runtime and with examples for object detection, gesture classification and optical flow
- New fully integrated RAW EVT2 encoder
- Support of Ubuntu 24
Existing SDKPro features:
- License allowing commercial use
- Access to all advanced add-ons source code
- Access to online documentation, including a Knowledge Center filled with application notes, technical briefs, user guides, and other valuable resources
- Access to advanced add-ons: High-Speed Counting, Spatter Monitoring, Vibration Monitoring, Object Tracking, Optical Flow, Ultra-Slow Motion, Visualization tools, Machine Learning, Active Markers, Object 3D Pose Tracking, 3D Estimation
- Access to advanced tools: Metavision Studio, Event Simulator, format converters, file manipulators
- 2H Premium support
- Will include future updates
ABOUT PROPHESEE
Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.
The company developed a breakthrough Event-based Vision approach to machine vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and algorithms mimic how the human eye and brain work to dramatically improve efficiency in areas such as autonomous vehicles, industrial automation, IoT, mobile and AR/VR. Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley.
The company is driven by a team of more than 100 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Intel Capital, Omnivision, Prosperity7 Ventures, Renault Group, Robert Bosch Venture Capital, Sinovation, Sony, Supernova Invest, Xiaomi.
Learn More: http://www.rfnf.cn/en
Prophesee’s Metavision? Image Deblur Solution for Smartphones is now production-ready, seamlessly optimized for the Snapdragon 8 Gen 3 Mobile Platform
MWC reveal showcases the multi-year collaboration between Prophesee and Qualcomm resulting in next generation blur-free mobile photography, now ready for customer integration into Snapdragon 8 Gen 3 enabled devices.
PARIS, February 27, 2024 – Prophesee SA, inventor of the most advanced neuromorphic vision systems, today announced that the progress achieved through its collaboration with Qualcomm Technologies, Inc. has now reached production stage. A live demo during Mobile World Congress Barcelona is showcasing Prophesee’s native compatibility with premium Snapdragon? mobile platforms, bringing the speed, efficiency, and quality of neuromorphic-enabled vision to cameras in mobile devices.
Fig 1: Prophesee Metavision solution introduced on main stage at Qualcomm’s Snapdragon Summit
Prophesee’s event-based Metavision sensors and AI, optimized for use with Snapdragon platforms now bring motion blur cancellation and overall image quality to unprecedented levels, especially in the most challenging scenarios faced by conventional frame-based RGB sensors, fast-moving and low-light scenes.
“We have made significant progress since we announced this collaboration in February 2023, achieving the technical milestones that demonstrate the impressive impact on image quality our event-based technology has in mobile devices containing Snapdragon mobile platforms. As a result, our Metavision Deblur solution has now reached production readiness,” said Luca Verre, CEO and co-founder of Prophesee. “We look forward to unleashing the next generation of Smartphone’s photography and video with Prophesee’s Metavision.”
“Qualcomm Technologies is thrilled to continue our strong collaboration with Prophesee, joining efforts to efficiently optimize Prophesee’s event-based Metavision technology for use with our flagship Snapdragon 8 Gen 3 Mobile Platform. This will deliver significant enhancements to image quality and bring new features enabled by event cameras’ shutter-free capability to devices powered by Snapdragon mobile platforms,” said Judd Heape, VP of Product Management at Qualcomm Technologies, Inc.
HOW IT WORKS
Prophesee’s breakthrough sensors add a new sensing dimension to mobile photography. They change the paradigm in traditional image capture by focusing only on changes in a scene, pixel by pixel, continuously, at extreme speeds.
Each pixel in the Metavision sensor embeds a logic core, enabling it to act as a neuron. They each activate themselves intelligently and asynchronously depending on the number of photons they sense. A pixel activating itself is called an event. In essence, events are driven by the scene’s dynamics, not an arbitrary clock anymore, so the acquisition speed always matches the actual scene dynamics.
High-performance event-based deblurring is achieved by synchronizing a frame-based and Prophesee’s event-based sensor. The system then fills the gaps between and inside the frames with microsecond events to algorithmically extract pure motion information and repair motion blur.
Learn more: http://www.rfnf.cn/en/event-based-vision-mobile/
ABOUT PROPHESEE
Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.
The company developed a breakthrough Event-Based Vision approach to computer vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and AI mimic how the human eye and brain work to dramatically improve efficiency in areas such as industrial automation, mobile, IoT, and AR/VR.
Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley. The company is driven by a team of more than 120 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Intel Capital, Prosperity7 Ventures, Robert Bosch Venture Capital, Sinovation, Supernova Invest, Will Semiconductor, Xiaomi.
Learn more: www.rfnf.cn/en
Snapdragon is a trademark or registered trademark of Qualcomm Incorporated. Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
Prophesee honored silver in the 2021 edition of Vision Systems Design Awards
Prophesee is pleased to announce Metavision? Intelligence Suite was recognized among the best in machine vision by the judges of the Vision Systems Design 2021 Innovators Awards program. The judging panel consisted of esteemed experts from system integrator and end-user companies.
In its seventh year, the Vision Systems Design Innovators Awards program reviews the most innovative products and services in the vision and image processing industry. Criteria used in the Innovators Awards ranking included: originality, innovation; impact on designers, systems integrators and end-users; fulfilling a need in the market that hasn’t been addressed, leveraging a novel technology, and increasing productivity.
“The Vision Systems Design team would like to congratulate Prophesee for their score in the 2021 Innovators Awards program,” says Chris Mc Loone, Editor in Chief. “Each year this unbiased and increasingly competitive program aims to celebrate the most innovative products and systems in machine vision. The Prophesee team should be very proud.”
Prophesee was honored silver in the Software category for our recently released Metavision? Intelligence Suite, the industry’s most comprehensive software suite for Event-Based Vision systems. It offers 95 algorithms, 67 code samples, 11 ready-to-use applications, and modules for event-based vision training, prototyping, and development. The included toolkit allows developers to build event-based machine learning networks using an HD dataset. Open-source modules unlock full interoperability between our software and hardware devices, enabling a fast-growing Event-Based community.
Luca Verre gave a talk at INSEAD Entrepreneurship Forum
Luca Verre was once again invited to represent Prophesee at INSEAD Entrepreneurship Forum (IEF) 2019 which was held on 20th and 21st september 2019 in Madrid, Spain.
Our CEO and co-founder, Luca Verre had an opportunity to share his thoughts of starting and running Prophesee over the past five years when he was invited to be the keynote speaker at the INSEAD Entrepreneurship Forum in Madrid, Spain recently.
Luca talked about the challenges met while starting Prophesee five years ago with colleagues who shared a vision for how they could apply characteristics from biology to improve how machines can process visual information.
He traced the road to success of Prophesee, from early start-up days to the company’s current status of having more than 100 employees, securing more than $40 million in investment capital, developing an active set of commercial engagements and delivering its first products to market.?Luca offered practical advice to the hopeful entrepreneurs at the event throughout a discussion with Adrian Johnson, adjunct professor at INSEAD.
Prophesee welcomes Japan’s Minister of science and technology?
Prophesee was recently invited to host “Pitch to the Minister: HIRAI Pitch”. Mr. Takuya Hirai, Japan’s Minister is in charge of Science and Technology Policy, Information Technology Policy, Space Policy, the Intellectual Property Strategy, and “Cool Japan” Strategy. Pitch to the Minister is an initiative created by the minister to exchange ideas and have discussions around the future of innovation in technology as well as the start-up ecosystem in Japan.
We presented to Mr. Hirai and 11 other Japanese officials from the Minister delegation and JETRO. We discussed how Event-Based Vision solutions will impact innovation and industry 4.0 in Japan as well as ways of?making it easier for French and other foreign start-ups to conduct business in Japan.?
Since Mr. Hirai was appointed as the Minister last October, he has conducted “Pitch to the Minister: HIRAI Pitch” more than 60 times in Japan. Friday’s HIRAI Pitch in Paris was the first time outside Japan.
For more on Mr. Hirai and his cabinet visit their website.
Prof. Davide Scaramuzza, director of the Zurich University Robotics and Perception Group, visits Prophesee
Davide Scaramuzza, who runs the Robotics and Perception Group of the University of Zurich?visited us at Prophesee’s office recently and?presented his work on motion estimation with event cameras (SLAM, visual-inertial odometry, feature tracking).
Davide has extensive experience with autonomous drones, including in the emerging sport of drone racing, which requires highly precise and responsive vision capabilities. The talk he gave focused on how Event-Based Vision enables better operational performance for drones used in rescue and inspection missions, where a fast response is also critical.
Davide showed how drones have the potential to navigate quickly through unstructured environments, enter and exit buildings through narrow gaps, and fly through collapsed buildings. However, their speed and maneuverability still need improvement. Indeed, agile navigation through unknown, indoor environments poses a number of challenges for robotics research in terms of perception, state estimation, planning, and control.
In his talk, Davide demonstrated that tightly-coupled perception and control is crucial in order to plan trajectories that improve the quality of perception. He also touched upon how using event-based vision better enables low latency sensory motor control and navigation in both low light and dynamic environments, where traditional vision sensors fail.
You can read more about Davide and the Robotics and Perception Group here.
Prophesee CEO and co-founder honored by Italian government
Prophesee CEO and co-founder Luca Verre was the recipient of a very special honor in his home country of Italy, being bestowed with an Innovation Award at the Conference of Scientific Attaches, held recently at the famed Villa Farnesina in Rome.
The Conference hosted at the Farnesina’s main focus was about Environmental protection, sustainable development and technological innovation which was held on 27th and 28th June.
Luca received one of two “Farnesina Awards” given at the event, with his being under the theme “Innovation that speaks Italian.” It recognizes the founder of a successful start-up operating abroad. The award was presented by Minister of Foreign Affairs and International Cooperation, Enzo Moavero Milanesi, and the Minister of University, Education and Research, Marco Bussetti.
The award underscores both the success Prophesee has achieved under the direction of Luca as well as the company’s own commitment to developing innovation without borders.?
At the award presentation, it was noted that Prophesee has demonstrated an impressive track record of innovation with its development of the industry’s first event-based vision processing technology. From self-driving vehicles, to higher performing industrial automation for Industry 4.0, to enabling vision in IoT devices – and even helping restore sight to the blind.
Also honored at the conference was Italian pediatrician, gastroenterologist and researcher Alessio Fasano, one of the world’s leading experts on celiac disease and nutrition.?
The network of Scientific Attachés is coordinated by the Foreign Ministry and facilitates scientific and technological cooperation with other countries and to provide support to Italian companies operating in advanced technology sectors.?
Minister Moavero Milanesi spoke of the international and shared nature of science, saying “Louis Pasteur said that science has no homeland because it is the heritage of humanity; that’s why we’re here. Science has no frontiers, it has no homeland, it is a precious common good. It is necessary to support it in order to maintain a sustainable development perspective.”
PROPHESEE at
WEF Annual Meeting of the New Champions? 2019
Prophesee was once again invited to attend the WEF Annual Meeting of the New Champions last week in Dalian, China. The theme of the gathering, held July 1 – 3, was Leadership 4.0: Succeeding in a New Era of Globalization. Continuing with the focus on Industry 4.0, Leadership 4.0 focused on the goal of understanding of how new champions that are gaining economic influence are disrupting and transforming current industry models.
Luca led a hub session on the future of machine vision, and he offered his views on how technologies are shifting beyond frame based imaging. Industries from autonomous vehicles to surveillance technologies were discussed. Luca presented how technological changes, such as Prophesee’s unique approach to event-based vision processing, are propelling the Fourth Industrial Revolution.
Attendees included leaders from all over the globe that are reshaping companies, communities and countries at an unprecedented speed and scale.The Annual Meeting of the New Champions is designed as the foremost global summit on innovation and entrepreneurship with more than 1,500 participants, 100 working sessions and community activities, along with the opportunity to engage in several new Forum initiatives.
PROPHESEE AT
CVPR 2019
Prophesee will once again be attending the Computer Vision and Pattern Recognition (CVPR) Conference?– this year in Long Beach, California from June 16-20.
We’ll be showcasing the latest demonstrations of our event-based vision technology in use for industrial applications such as vibration monitoring. The interactive demos showcase the accuracy, power efficiency and performance of our unique bio-inspired technology.
Demonstrations will be held throughout the day between June 16 and 18?in the Prophesee Booth 1752
We are also presenting a poster entitled:
Speed Invariant Time Surface for Learning to Detect Corner Points with Event-Based Cameras.
The poster is based on the paper that we published, that you can find?here.
To evaluate event-based corner detectors:
?To discover more about event-based vision,?come by our Booth 1752
PROPHESEE at
Embedded Vision Summit 2019
Prophesee CEO, Luca Verre will be delivering a talk in Embedded Vision Summit held in Santa Clara, California in May, 2019.? His talk “Neuromorphic Event-Based Vision: From Disruption to Adoption at Scale” will explain the core principle of Prophesee’s event-based vision technology.
Attendees will experience how this new Machine Vision category opens vast new potential in applications such as autonomous vehicles, industrial automation, IoT, security and surveillance and AR/VR.
The talk will be held in Exhibit Hall ET 2 on Tuesday, May 21 at 2:45 pm
Prophesee will also be unveiling demonstrations of key use-cases at this year’s event, featuring its Onboard?reference system solution, which is aimed at developers of vision-enabled industrial automation systems such as robots, inspection equipment,?monitoring and surveillance devices.??
Demonstrations will be held throughout the day on Monday and Tuesday, May 20 & 21 in the Prophesee Booth 518
Experience first-hand a vibration monitoring demonstration that accurately and continuously monitors?equipment vibration signatures.
PROPHESEE Event-Based vision is now available in an industrial automation environment, providing a much more efficient and cost-effective way to perform maintenance and safety operations.
Discover IMAGO VisionCam, Powered by Prophesee,?the first Event-Based industrial grade vision system.
?To discover how?Prophesee’s?event-based approach is changing the world of?Vision, come by our Booth 518