엠에스텍

SITE MAP

Solution

Business Model

AI ROBOTICS

Smart logistics system is on-site automation by controlling and managing/operating all activities of logistics sites in real time by combining various IT technologies (artificial intelligence, information communication technology, sensor and control technology, etc.) and services in existing logistics centers. It is a system that aims to improve efficiency and sustainability in logistics operations and reduce logistics costs through construction and unmanned facilities.

Smart Logistics System Overview

AI-based smart logistics robot that gives robots vision and intelligence (AI) to enable logistics tasks instead of humans.

Logistics robot element technology

AI-based 3D object detection algorithm

Smart 3D Vision Object Detection Algorithm

Smart detection algorithm that can detect objects of different shapes, sizes, randomly placed objects, and even if the image is shaken

Actual detection test pictures
Artificial intelligence model for extracting visual features of various types of objects

Extraction of visual features required for object detection in images through AI models such as Autoencoder, CNN etc.

Autoencoder

Encodes the input image to a lower dimension than the input dimension, decodes it again, and outputs an image close to the input image

CNN feature

Extract important features using a CNN model trained on a large amount of image data

AI model for extracting visual features of various types of objects

Extract the geometric features required for object detection from the point cloud

CNN feature

Improved and utilized AI models that fit geometric features. Extract geometric features by modifying/improving AI models such as FCAF3D and STRL designed in consideration of the point cloud characteristics

AI Model for Extracting Visual Features of Multi-Variety

AI model that extracts multimodal features by combining/selecting the extracted visual and geometric features, and finally detects the box

3D bounding box and classification result for the detected object are output

Bounding Box Example
Advancement of AI model

Improving detection ability through continuous AI training

AI training pictures

Robot path/motion control technology

3D position/vector calculation of multi-variety objects and robot posture determination algorithm
Voxelization

Reduce noise and point cloud computations using RANdom SAMmple Consensus (RANSAC) model

Homogeneous Transformation

Set reference coordinate system between RGB camera and lidar/ToF camera in 3D vision

Box detection and three-dimensional position calculation test
Calibration for 3D Vision-Robot-to-Robot Coordinate System Synchronization
  • 1) Attach the 3D vision to the robot
  • 2) Taking a sample object and acquiring a 3D image while moving the robot
  • 3) Set the reference coordinate system between the robot and 3D vision through Homogeneous Transformation
Model-Based Path / Motion Generation
  • 1) Create the path of the robot arm using the acquired robot's current position and the position of the sample object
  • 2) Create a model or a predetermined map for the environment (obstacles etc.) around the robot acquired with SLAM and use it to create a path
  • 3) Create an optimal path to move in the shortest time using OMPL, MoveIt etc.
Model-Based Path Generation
Model-Based Path Generation