Introduction Â
The ability to measure objects at a distance to determine how far away they are and/or their overall dimensions is becoming more popular in Imaging. With this, there are several different techniques and technologies, each with their own advantages and disadvantages. Picking the right one can be daunting without someone in your corner to help decipher your needs and direct you to the best product to meet them.Â
A popular technology that is gaining recognition is Time of Flight (ToF) for its simplicity and ease of use. These products are based on measuring the time it takes light to travel to and from a reflective surface. It works by having a camera send out a light pulse or stream of pulses and measuring the time delay for it to be detected back at its sensor’s pixels. With this time measured, an accurate distance can then calculated and a depth map created. Â
ToF Types
There are two distinct approaches used in ToF systems, each with their specific advantages within a given application. Direct ToF (dToF) uses a short light pulse, about a few nanoseconds in length, the delay between the emission and the reflection from the target is measured and the distance to the target can then be determined.Â
For Indirect ToF (iToF), the principle is similar to dToF with the exception of pulses of light are sent as a stream, where the emitted light is modulated. The receiving sensor repeatedly measures reflected light identifying the phase difference between the outgoing and reflected signal. This phase angle can then be used to determine the distance of the target through a simple calculation.Â
In addition to imaging in X and Y directions, 3D image sensors also acquire the Z-direction (e.g. depth) information, enabling 3D sensing. ToF image sensors detect distance information of each pixel, creating highly accurate depth map.Â
CONVENTIONAL
NEW
3D sensing opens up the possibility of discerning things that are difficult with conventional 2D images, as in inspection based on volume or shape, or discerning overlapped objects.Â
Sony has introduced a line of iToF products such as IMX556 and the new IMX570 sensor that are especially effective in high-speed, high-resolution 3D imaging of objects at short and long distances.Â
Key Features of Sony’s New IMX570 Sensor
The new IMX570 is a 1/4.5-type VGA sensor with 5 µm pixels that reaches a frame rate up to 56 fps.Â
Key Features of Sony’s IMX556 Sensor
The IMX556 is a type 1/2-type VGA sensor with 10 µm pixels that reaches a frame rate up to 60 fps.
Logistics
Ideal for optimizing material handling lines by measuring positions, sizes and loading rate of pallets or cargos, and for autonomous mobile systems such as AGVs and last-mile robots.
Factory Automation
Detection of intrusion into hazardous area, operation monitoring and object location detection for robot picking.
Commercial & Public Facilities
Easy and accurate measurement of crowd levels at stores, airports, theme parks and other public locations as well as sophisticated access control.
Farming & Agriculture
Quality control and productivity improvements, e. g. automated milking, body condition scoring, feed amount detection along with other shape related applications like automatic fruit picking.
Civil Engineering & Construction
Detection of environmental features or objects and support for driver assistance, vehicle automation, site visualization/documentation.
Sony’s IMX570 Features State-of-the-Art iToF Technology
Sony has released a back-illuminated, time-of-flight 3D image sensor for industrial machineries. The new IMX 570 is a type 1/4.5 VGA sensor with 5 µm pixels. Â
Applying Sony’s sensing and ranging technologies, the compact and high-resolution sensor acquires depth data which can cover both short and long distances. Â
Key Features of Sony’s New IMX570 Sensor:
- Delivers high-resolution 3D images
- Suppresses blur of moving subjects
- Reduces processing load
- Improves robustness in all environments
FSM-IMX570 Developer Kit
This package includes everything needed to operate the sensor, and get a 3D Depth Map working with your application. In addition, camera developers can receive raw image data, and implement the depth processing by themselves, while comparing it at any time with a calibrated reference implementation on the same hardware.
The package provides open-source drivers as blueprint, providing base functionality, flexibility and transparency within the NVIDIA Jetson Family – one of the most powerful embedded processing platforms currently available.
Image: FRAMOS ToF Developer Kit (NVIDIA Jetson embedded computer not included)
What’s in the Kit
The FRAMOS FSM-IMX570 Developer Kit is a single, calibrated assembly that includes the following components:
The Sensor module includes the Sony IMX570PLR-C Indirect Time-of-Flight (iToF) sensor, which produces a 640×480 image at 30 fps, and is equipped with an M12 lens which has been optimized and factory-aligned for the sensor.
Active IlluminationÂ
The illumination component is equipped with 4 VCSEL Laser Diodes utilizing specialized Sony Drivers, inputs for an external power supply, and an FFC connector for synchronization with the FRAMOS Sensor Module.
Onboard Depth Processing
The kit utilizes the standard Ecosystem approach, incorporating a FRAMOS Sensor Adapter board and adding a Sony Depth Processor to the sensor periphery; providing the versatility of the FRAMOS PixelMateâ„¢ MIPI CSI-2 interface.
Processor Board Adapters
Via its PixelMateâ„¢ interface, the front-end provides full compliance with the Processor Adapter Boards of the FSM Ecosystem.Â
Each Developer Kit includes a FRAMOS Processor Board Adapter, that provides physical connectivity to a variety of embedded processing platforms (SOCs / SOMs), and the NVIDIA Jetson Family of products, including the AGX Orin, Xavier, Orin, Xavier NX, TX2 NX and Nano.Â
Get up and Running FastÂ
FRAMOS’s FSM-IMX570 Developer Kit is the first product of its kind to provide easy functionality and full component level control for the next gen of Sony DepthSense™ sensors within the NVIDIA Jetson family of SOMs for Embedded solutions, and includes everything needed to get a Sony IMX570 iToF sensor up and running and an image on your screen in less than an hour.
This new offering leverages FRAMOS’s long-standing partnerships with Sony and NVIDIA to create a path forward for companies seeking to develop their own 3D vision solution for robotics, logistics, and other applications.
Available products
