Orbbec Core Technology

Orbbec designed a system level SoC chip ---- structured light depth engine. The depth engine innovatively integrates stereo vision technology with structured light technology, and this is one of Orbbec's core technologies.

Orbbec created a structured light chip to tackle use cases (indoor, outdoor, strong backlight, etc.) This innovative chip, reduces the overall power consumption, and effectively improves the performance of the structured light module.

Orbbec designed the AIoT computing chip with large scale depth processing and AI in mind. The chip consists of a central processing unit, depth computing engine and supports iToF, stereo vision computing and more.

Orbbec's dToF chip with system level anti-interference, multi-frequency fusion technology, and independently developed the pixel structure, pixel unit, high performance quenching circuit, flexible and adjustable circuit, and high precision TDC.

Orbbec designed a multi-tap infrared CMOS image sensor with BSI pixel design, 3D stacking, anti-interference, high precision ADC and high speed data transfer that can meet the needs of multiple photon acquisition in a single cycle under pulse modulation.

Orbbec has designed the structured light , stereo matching and iToF algorithms to calculate depth information. The algorithms are generated by the computer, then optimized and verified by FPGA, and finally rewrite and designed into ASIC chip.

Orbbec's AI algorithm for consumer products includes, body tracking, background segmentation, 3D reconstruction, VSALM and immersive AR, etc. Most algorithms has already been introduced to the market and works seamlessly with Orbbec camera products.

Orbbec developed flexible camera calibration, 3D reconstruction and dynamic deformation detection to cope with 3D measurement scenarios in industrial areas. Orbbec also introduced 3D point cloud data post-processing technology.

Orbbec has developed multiple optical measurement systems for applying to structured light, iToF, dToF, Lidar and other products.

Orbbec developed a laser projection module composed of laser transmitter, lens, and diffractive optical element (DOE), used to project speckle beam into space. Orbbec has innovated in product miniaturization, DOE damage detection, and laser projection.

Orbbec has built firmware and drivers for controlling and developing with 3D camera products, including drivers for setting and accessing various components on the camera and providing application programming interface for the SDK.

Orbbec developed middleware and SDK enables 3D camera products to achieve a more accurate 3D vision perception measurement. The SDK supports Windows, Linux, Android, Unity, ROS, OpenCV and other major platforms for rapid development​.

Orbbec integrates many industrial grade algorithms to form a software platform with standard interface, framework and visualization. With a software platform, Orbbec has the ability to help customers with specific development and customization.

Orbbec developed multi-level calibration, including multi sensor intrinsic/extrinsic, structured light based speckle patten, and ToF based pixel calibration. Orbbec also built the RGB-D alignment to eliminate inconsistencies caused by module differences.

Orbbec is developing a self-calibration system which will automatically calibrate and compensate errors caused by temperature and external force. This technology will be key for a 3D camera running for long-term and stably output depth image.

Orbbec has developed highly-precise and highly-efficient testing and production equipment to support technology advancements in the fields of assembly, calibration, alignment, and in mass production.