Prototype Event-based Vision Systems with the FRAMOS FSM-IMX636 Devkit on the NVIDIA Jetson Platform for Edge AI and Robotics 

Prototype Event-based Vision Systems with the FRAMOS FSM-IMX636 Devkit on the NVIDIA Jetson Platform for Edge AI and Robotics 

Unlike conventional imaging technologies that transmit entire images, the IMX636 sensor, realized in collaboration between Sony and PROPHESEE, captures only changes in each pixel, allowing for the detection of even the slightest vibrations, subtle movements, and fast-moving objects with unprecedented accuracy and the tracking of people without creating privacy issues.   

With its performance and reduced processing power and bandwidth requirements, event-based sensing (EVS) technology expands the limits of embedded vision systems with unprecedented capabilities and precision, overcoming the limitations of conventional solutions.  

The FRAMOS IMX636 Development Kit allows you to easily test Sony EVS technology on the NVIDIA Jetson AGX Orin and Jetson AGX Xavier system-on-modules to discover new capabilities or improve the current performance of embedded vision systems.  

Benefits of Event-Based Sensing Technology

Event-based sensors achieve high temporal resolution (up to microseconds) and dynamic range (up to 140dB) while reducing data redundancy and power consumption.   

Their high precision, ability to capture even the slightest changes, invisibility to other sensors, decreased data transfer, and power efficiency due to operating only with changing data opens new horizons in fields such as robotics, autonomous driving, industrial automation, and biomedical imaging.  

The FRAMOS FSM IMX636 Development Kit allows you to test Sony IMX636 image sensor capabilities and then quickly scale them to production, simplifying the product development process. 

Event-based Sensing Technology Use Cases 

Here are a few use cases where EVS technology exceeds conventional sensing technology, allowing developers to capture data with unprecedented speed and precision. 

Preventive Maintenance through Vibration Monitoring  

When machinery starts to develop faults, such as bearing defects or misaligned belts, it generates abnormal vibrations. EVS can identify even the slightest deviations from standard vibration patterns, enabling early fault detection and repair before it causes severe and expensive damage.  

Robotics Navigation

EVS technology’s fast and reliable data processing in real-time brings higher performances to robotics navigation, allowing robots to avoid obstacles, navigate in a more agile and responsive manner, and make fast and well-informed decisions in dynamic environments.  

EVS can provide more regulation-compliant security and safety solutions since it can avoid capturing facial details, instead focusing on tracking movements – i.e., it can count people without compromising privacy. That is very important in regions with strict data privacy regulations, such as the EU. 

EVS allows retailers to gather valuable marketing and sales data without violating individuals’ privacy rights. 

High-Speed Object Counting and Tracking  

Event-based algorithms, the core of EVS technology, are very reliable at high-speed object counting, exceeding a thousand counts per second. This makes EVS sensors ideal for applications like counting sparks in welding or tracking fast-moving objects like golf balls.

Benefits of Testing EVS Technology With the FSM IMX636 Development Kit on NVIDIA Jetson AGX Orin and Jetson AGX Xavier 

The FSM-IMX636 Devkit provides an all-in-one package, enabling testing event-based vision sensors on NVIDIA Jetson AGX Orin and Jetson Xavier modules. The NVIDIA Jetson platform provides a rich set of tools and libraries to help developers integrate event-based sensors with AI models and optimize their performance and efficiency, allowing them to test all the FSM IMX Development Kit’s capabilities easily.   

Besides that, the NVIDIA Jetson platform also offers advanced AI and machine learning capabilities, excellent connectivity, and I/O options.   

As mentioned above, a seamless transition to practical use is one of the most important advantages of testing EVS technology with FSM IMX636 on NVIDIA Jetson AGX Orin and Jetson AGX Xavier. If EVS benefits your embedded vision systems, the testing kit provides a foundation to develop your product rapidly, significantly reducing costs and time to market. 

Learn more about FSM IMX636 on this page, and if you would like to dive into more details about EVS technology, follow this link. 

Stay Tuned with FRAMOS. Sign Up for our Monthly Newsletters

Contact Us

Salutation*
First Name*
Last Name*
Job Title*
Company*
Email*
Phone*
Country*
What FRAMOS product or service would you like to know more about?*
By submitting this request, your data will be processed to get in contact with you. If you become a customer of FRAMOS, you will receive regular updates, advertisements and other marketing communications from FRAMOS per e-mail. You can object to receiving these types of e-mails at any point without charge by contacting FRAMOS or by unsubscribing in the respective e-mail. For more information about the processing of your data, please take a look at our privacy policy.

Contact Us

Salutation*
First Name*
Last Name*
Job Title*
Company*
Email*
Phone*
Country*
By submitting this request, your data will be processed to get in contact with you. If you become a customer of FRAMOS, you will receive regular updates, advertisements and other marketing communications from FRAMOS per e-mail. You can object to receiving these types of e-mails at any point without charge by contacting FRAMOS or by unsubscribing in the respective e-mail. For more information about the processing of your data, please take a look at our privacy policy.