Академический Документы
Профессиональный Документы
Культура Документы
Version 1.0
Author(s): LA
File:
The copying and transmission of the entire document or individual sections of text, drawings or
pictures is allowed, the copyright only if they previously agreed. This is also valid for coping by any
method including storage and any transfer on paper, transparencies, films, tapes, discs and other
media.
Copyright © 2013
LASE Industrielle Lasertechnik GmbH
Rudolf- Diesel-Str. 111
D 46485 Wesel
Trade-marks
TM TM TM
Windows XP , Windows Vista und Windows 7 are registered trade-marks of the Microsoft
Corporation in the USA and other countries.
© TM
Acrobat Reader is a trade-mark of Adobe Incorporated.
FIGURES
Figure 3: 3D-Scanner mounted at the pole (6m height), ......................................................................... 4
Figure 5: 3D-Scanner mounted under a weather protection roof ............................................................ 5
Figure 6: Hardware for 6 lanes (for the customer one Laser scanner is sufficient) ................................. 6
Figure 9: LASE LASETDS application – measurement result (calculated center) .................................. 9
Figure 10: LaseTDS application – measurement result (twist lock positions) ....................................... 10
Figure 11: 40” trailer in the lane ............................................................................................................. 11
Figure 12: LASE – 3D-image 40’ trailer (different screenshot, fit not to the picture above, but showing
the principle) .......................................................................................................................................... 11
Figure 14: LASE Test application – Calibration screenshot 2 ............................................................... 12
Figure 15: LASE Test application .......................................................................................................... 13
Figure 16: Calibration – internal transformation list ............................................................................... 13
Figure 17: HHLA CTB ASC with 2 x 3D-laser scanner ......................................................................... 19
Figure 18: Mounting position of the laser scanner at ASC .................................................................... 20
Figure 18: Mounting position of the laser scanner at ASC .................................................................... 20
Figure 19: Hardware-Overview .............................................................................................................. 21
Figure 20: Measuring of target area in crane travel axis (drawing is from a project, where lans markers
are used) ................................................................................................................................................ 23
Figure 21: 3D-view of measurement data (target container) ................................................................. 24
Figure 22: gap detection (top view) ....................................................................................................... 25
Figure 23: shadow areas in stack verification mode.............................................................................. 26
Figure 24: back edges of truck and trailer ............................................................................................. 27
Figure 25: LASE3000D-C3-226 ............................................................................................................. 27
Figure 26: LaseASC application ............................................................................................................ 28
Figure 27: View scanner ........................................................................................................................ 29
Figure 28: 3D-View ................................................................................................................................ 29
3 Solution
The following products of LASE have to utilize
LaseTDS for automatic landing of container on a route trailer, with the following functionality
- Detecting Twistlocks
- Calculating down position
- Obstacle detection
- Cabin position detection
- Truck trailer combination evaluation
- Truck lifting detection
Additional sensors have to measure the position of the Headblock and the Spreader.
3.1 LaseTDS
3.1.1 Definition Coordinate system
To be able to verify all values measured by the LaseTDS and LaseASC application, a surveyor
has measured the absolute positions of the reference markers and for each trailer measurement
position the absolute coordinates of each of the twist locks.
Therefore a common coordinate system was defined. This was used from the surveyor and the
LASE LASETDS application as well. Thus all measured positions are related to the origin of the
used coordinate system as follows:
Y = reference markers
Truck lane 1
Truck lane 2
The origin was at the beginning of the two truck lanes in the center line between both lanes. The
X-Axis was running to the right beginning from the origin straight through the center of the
marker and the lamp pole.
Description value
Measuring range (at 10% remission) 26m
Measuring frequency 25 – 100Hz
Angle step (scanner) 0,1667 – 0,5°
Resolution ±12mm
3.1.3 Installation
Figure 4: 3D-Scanner mounted at the pole (6m height), here a system for 6 lanes
Figure 6: Hardware for 6 lanes (for the customer one Laser scanner is sufficient)
Apart from that the upper mentioned result (calculated center) the application shows the
measured positions of each single recognized twist lock. Provided are the twist lock coordinates
(X, Y, Z). Additionally the status of the internal calculations is given. The status is shown via
check boxes. As an example here is a short explanation of the meaning of few of check boxes:
- Y LO/Y HI indicates on which side of the trailer the twist lock was found.
- Hindernis Y is set if there is an obstacle between twist locks in Y direction
- Detected says whether a twist lock could be recognized from the 3D data or not
- Calculated is set when the twist lock could not be recognized and the software has
calculated its position
- Shadowed indicates that a twist lock could not be recognized because of a shadow (no 3D
data) caused by a container or similar
3.1.6.2 3D-View
The LaseTDS application provides the possibility to show the scan data in a 3-dimensial view.
LaseTDS is transforming the incoming scan data according the calibration offset values. The
result is a 3D image which fits to the real environment.
The figure below shows a screenshot of the 3D-view. The reference markers are marked with
the yellow arrows (just 5 are pinpointed). The different colors are representing different height
level. Dark blue relates to ground level. Red relates to top edge of trailer.
The color gradient can be adjusted.
Figure 12: LASE – 3D-image 40’ trailer (different screenshot, fit not to the picture above, but
showing the principle)
3.1.6.3 Calibration
As a first step the measured absolute coordinates (nominal values) are typed in on a special
dialog (see above).
The first screenshots below (left) is showing a 3D-image of one reference marker. The red cube
around the marker represents the internal search area for the reference marker. Only
measurement points inside of this area will be used for the calculations. From all points inside
the area the points which hitting the top of the half sphere are separated (screenshot right, red
points).
By changing the transformations for the incoming scans step by step the LaseTDS calibrations
tries to match the transformed scan data as good as possible to the nominal reference marker
positions. The following both screenshots are showing the transformation at the beginning (left)
and at the end of the calibration sequence (right).
The light green sphere is representing the nominal position. The dark green sphere is
representing the current position. The center is marked by green and blue lines. The deviation
in the first screenshot is several centimeter. In the right picture both position are matching
perfectly.
The screenshot below shows the 3D-scan data fitting perfectly to the nominal reference
marker positions.
The following screenshots are showing different steps of the internal twist lock recognition
algorithms. The algorithms are not using any kind of trailer shape detection. There is no need
to have a data base of different trailer shapes measured trailers can be compared to. Thus the
shape of the trailer doesn’t matter. The algorithms are just searching for objects which could be
a twist lock.
In the next step each found twist lock must have a defined relation (certain distance in X, Y and
diagonal) to other found twist locks. If there is a relation the twist lock will be marked as a valid
twist lock. That makes the twist lock recognition independent from the trailer shapes.
The image below shows a detail of found twist locks of image above
3.2 LaseASC
The LaseASC is a laser scanning system which processes 3-dimensional measurement data provided
by one or two 3D-Laser scanner. The LaseASC application collects the scanning data and calculates all
needed information from these data.
In the Automatic Stacking Crane (ASC) the crane control system (CCS) will use LaseASC
measurement results as one input to control
Exact position measurement of the container in the stack (block)
Stack verification mode
Position measurement of AGVs on the waterside transfer area
Position measurement of the Terminal Trailer for semi-automatic handling
Automatic lifting up of container from route trailer
Rough Position measurement of route trailer for semi- automatic loading of trailer
The measurements will started by a special trigger message from PLC. All measurements will made
when ASC has reached the nominal slot position.
Figure 17: Work principle with the two scan planes of the two 3D-laser scanner
3.2.2.1 General
The software of the measurement system is been developed and tested in C++ (MFC, Doc/View
architecture) with help of the development environment Visual Studio 2003 for Windows XP
Professional.
The different modules are activated by a program sequence control. The program sequence control
works with an internal cycle time of approximately 10ms. Which modules are activated depends on
which functionality is ordered by the PLC. The picture at the next page shows an overview about the
program sequence.
For storing (logging) of all events and error messages the measurement system uses human readable
log-files. There is no database used. In case of error analysis this files can opened with Microsoft Excel
or with any other text editor. It is also possible to activate the logging of all incoming data (scanner, servo
drive, PLC communication). This feature will be used during the commissioning and in case of analysis
of malfunction. The size and amount for the log-files respectively the log-folder is adjustable. If the
amount of log-files or the adjusted maximum sizes will be overstepped, the oldest files will be deleted.
reached the target area a START measurement message is send by the PLC. The measurement ends
when PLC sends a STOP message
All below described possible measurement tasks will handle in the state measurement!
Figure 22: Measuring of target area in crane travel axis (drawing is from a project, where lans
markers are used)
Different algorithms are used to filter the measurement points and to recognise the edges of the target
container.
First step is to measure the scenario. With the knowledge of the trolley position and the nominal target
position the search area (for container edges) can be limited. It is only possible to detect edges of the
highest container, which should be the target container. Next step is to separate the highest
measurement points, which represent the upper edges, from other points. Therefore gaps in X and Y
direction are searched to roughly find the outer edges. Result is a “ribbon” of measurement points (see:
Figure 23: 3D-view of measurement data (target container)). Through the outer points of these remaining
measurement points a straight line is placed which represent the outer edge in Y direction. To find the
edges in X direction a virtual cube is placed at the ends of the points. With different filters and
calculations the edge is determined from the points inside of the cube.
This procedure is the same for both 3D-Units. If there are measurement points from both units the
container width is the distance between both lines. If there are only points from one unit the LaseASC
uses the width information (from PLC) for the expected target container.
Recognized
target Measured
container container
edge (green
ribbon)
The picture above shows the measurement data of only one 3D-Unit (light green points). The data from
the other 3D-Unit are blinded out.
The white box is a detected container at top of a five high stack. It’s also possible to see parts of the
container edges of the lower containers (light green lines).
In the following figures different setups (combinations) of containers in the stack area are shown. The
red container shows the respective target position. By means of this configuration it is recognizable that
always at least 3 land marks are detected by the scan planes.
3.2.2.4.2 Measuring the space between target slot and the edges of container in adjacent
stacks (gap detection).
If it is required by PLC the LaseASC measures the gap between the target slot and the adjacent stacks.
This is to avoid any collision while lowering or pick up the spreader or a container at spreader (decided
by PLC).
The gap detection takes place when the 3D-Units swivel from the target area to the adjacent stacks.
After the gap area is measured and all data are stored in LaseASC application, two adjustable 3
dimensional cubes are added to the measurement points (at target position). If the areas between both
cubes are violated by more than 40mm a collision warning will be send to the PLC.
The gap detection works only until the height of the target area.
The picture above shows the top view to a target area surrounded by several container stacks. The both
red rectangles are the cubes mentioned above. If the area between this both red rectangles is violated
(e.g. not enough space for place for lowering a container), shown at the top part of the picture, a collision
message will be send to PLC.
3.2.2.4.3 Measuring distance to stack underneath and determine stack height in stack
verification mode
To check if stocking level is concordant with reality, the crane can drive well directed to positions in the
stack to verify the state. Therefore the crane and trolley are positioned upright over the slot which shall
be checked. The scanners are swiveled to the middle of the slot and then starting swiveling the edges.
After the target area is totally scanned the highest level will be determined from the recorded data and
send to PLC.
It is not possible to check several stacks per lanes because of shadowed areas (i.e. perhaps a scanner
can’t see containers in tier 1 behind a stack of 5 container height, see picture below).
With the previous knowledge about which scene shall measure (20’, 40’, general, open top,..) the
measuring system measures the highest point within the predetermined area. Height measurement is
made with an accuracy of +/- 50 mm.
Sequence of stack verification mode
crane moves to position which has to be verified
if necessary 3D-Units swivel to start angle
crane achieves the position which has to be verified
3D-units swivelling to outer edges
The measurement system measures and calculates the height of stack
Measurement is ready, data will be send to PLC
Crane moves to next position or verification mode stops
3.2.2.4.4.2 Trailer
To measure known terminal chassis or a container on a loaded chassis at landside transfer point and
to determine chassis position (centre point of back edge: x, y, z and skew of trailer) or container locations
(centre point x, y, z and skew of container) relative to the current trolley position with an accuracy of +/-
200mm. For road chassis it is only possible to do an approximately chassis position detection because
of to many different shapes.
3.2.2.6 Software
The LaseASC application works automatically together with PLC and needs in ASC operation no
interaction from staff.
The application offers several views and dialogue boxes for the operation, calibration and monitoring.
The figure below shows for instance the application “main” view. This view is called “diagnostic view”
and provides all important information to the status of LaseASC.
This screen will be mostly needed while the first operation and/or while the process of the calibration.
This data will be continuously updated, so that the result will be a moved picture.
3.2.2.6.2 3D-window
The 3D-window is an OpenGL based window, which allows showing a 3-dimensional image of the
scanner data.