•ꢀ 2D/3Dꢀpatternꢀmatching
•ꢀ Backgroundꢀmodelingꢀandꢀsubtraction
•ꢀ Objectꢀfeatureꢀextraction
•ꢀ Edgeꢀdetection
centralized processing in industrial automation
systems.
These end equipments get their video
content through a network connection and
mayꢀhaveꢀtoꢀencode/transcodeꢀtheꢀvideoꢀ
before storing it. Video can then be retrieved,
decoded/transcodedꢀwhenꢀnecessary,ꢀandꢀ
have various analytics algorithms run on all or
parts of the video stream. Common analytic
algorithms used in surveillance are:
With the Cortex-A15 processors in the K2H
and K2E devices and the development tools
and programming models available from TI,
developers have the ability to support full ARM-
based Linux™ systems while offloading the
real-time processing to the high-performance
C66x cores. The offloading of real-time
processing enables a more power-efficient,
high-performance centralized processing unit.
For more complex systems requiring additional
processing capacity, TI’s HyperLink can be used
to connect multiple KeyStone devices adding
additionalꢀC66xꢀDSPꢀcoresꢀand/orꢀCortex-A15ꢀ
processors.
•ꢀ Dilationꢀandꢀerosion
•ꢀ Thresholding
•ꢀ Imageꢀwarping
•ꢀ Tamperꢀdetection
•ꢀ Opticalꢀcharacterꢀrecognitionꢀ(OCR)
•ꢀ Edge-ꢀandꢀsurface-basedꢀinspection
•ꢀ Defectꢀidentificationꢀandꢀclassification
•ꢀ Featureꢀandꢀtoleranceꢀverification
•ꢀ Colorꢀidentification
•ꢀ Motionꢀdetection
•ꢀ Tripꢀzone/boundaryꢀcrossing
•ꢀ Objectꢀdetection/removal
•ꢀ Objectꢀidentification
•ꢀ Objectꢀcounting
The combination of these functions in
an industrial automation system requires
significant real-time processing. These
processing functions can be implemented in
a smart industrial imaging camera with a low-
power, high-performance processor like TI’s
TMS320C665x multicore DSPs which provide
enough processing power to do many industrial
automation functions while remaining within
the power limitations of the camera.
Where more processing is needed or post
processing analysis is desired, a multi-headed
processing unit taking input from several
cameras in a centralized vision processing
unit as part of a comprehensive industrial
automation system is deployed, as shown
in Figure 2. This central system typically is
responsible for most of the analytic processing.
The K2E and K2H SoC platforms provide
an elegant, scalable solution for this type of
•ꢀ Objectꢀtracking
Becauseꢀtheꢀprocessingꢀelementsꢀofꢀ
the KeyStone SoCs are programmable and
scalable, the system has maximum flexibility,
allowing the same processing system to
be used across different product lines. The
scalability is further expanded because the
C66x cores in the K2H platform are the same
as those in the C665x platform. Therefore,
code developed for the C66x core that is used
in the central processing unit can migrate to
the smart automation camera and vice versa,
allowing maximum reuse and scalability.
•ꢀ Behaviorꢀanalysis
•ꢀ Facialꢀrecognition
•ꢀ Licenseꢀplateꢀrecognition
TI’s KeyStone II SoCs are well equipped
toꢀhandleꢀtheꢀcombinationꢀofꢀtheꢀNVR/DVRꢀ
functionality and the need for processing the
analytics algorithms listed above.
KeyStone II devices feature a network
coprocessor AccelerationPac. This
AccelerationPac consists of a packet
accelerator and a security accelerator that
work in tandem to offload the DSP and
ARM cores. This enables high-performance
network application processing while freeing
the C66x DSP and Cortex-A15 processors for
otherꢀfunctionsꢀlikeꢀanalytics,ꢀvideoꢀencode/
decode, running the operating system (OS)
Video Surveillance: Video surveillance appli-
cations will also benefit from TI’s K2H and K2E
platform of devices. This is particularly true in
the popular network video recorder (NVR) and
digital video recorder (DVR) hybrid, known as an
NVR/DVR,ꢀandꢀtheꢀstandaloneꢀanalyticsꢀservers.
Multi-Head
Vision Controller
66AK2H06 SoC
inside
Multicore Navigator
+
-
+
-
+
-
+
-
*
*
*
*
Power
Manager
System
Monitor
+<<
+<<
+<<
+<<
*
*
*
*
System
C
6
6
x
D
S
<P<C66x- DS<P< C66x- DS<P<C66x- DS<P<
Services
Debug
EDMA
ARM A15 ARM A15 ARM A15 ARM A15
011100
C66x DSP C66x DSP C66x DSP C66x DSP
1
MB
011100
1
1
MB
011100
1
1
MB
011100
1
1
MB
011100
1
100010
001111
4
MB
MB
MB
MB
MB
Security AccelerationPac
Packet AccelerationPac
011100
011100
011100
011100
011100
100010
001111
Multicore Shared Memory Controller
6
M
B
DDR3/3L
64/72b
DDR3/3L
64/72b
Ethernet Switch
PCIE
E
M
I
F
1
6
UART
SPI
I2
C
HyperLink
USB
3
SRIO®
Ethernet
Figure 2 – Example of 66AK2H06 SoC used as the main processor in a multi-head vision controller used to control multiple cameras and run analytics in an industrial
automation system