Dr Shufan Yang S.Yang@napier.ac.uk
Associate
A neuro-inspired visual tracking method based on programmable system-on-chip platform
Yang, Shufan; Wong-Lin, KongFatt; Andrew, James; Mak, Terrence; McGinnity, T. Martin
Authors
KongFatt Wong-Lin
James Andrew
Terrence Mak
T. Martin McGinnity
Abstract
Using programmable system-on-chip to implement computer vision functions poses many challenges due to highly constrained resources in cost, size and power consumption. In this work, we propose a new neuro-inspired image processing model and implemented it on a system-on-chip Xilinx Z702c board. With the attractor neural network model to store the object’s contour information, we eliminate the computationally expensive steps in the curve evolution re-initialisation at every new iteration or frame. Our experimental results demonstrate that this integrated approach achieves accurate and robust object tracking, when they are partially or completely occluded in the scenes. Importantly, the system is able to process 640 by 480 videos in real-time stream with 30 frames per second using only one low-power Xilinx Zynq-7000 system-on-chip platform. This proof-of-concept work has demonstrated the advantage of incorporating neuro-inspired features in solving image processing problems during occlusion.
Journal Article Type | Article |
---|---|
Acceptance Date | Jan 5, 2017 |
Online Publication Date | Jan 20, 2017 |
Publication Date | 2018-11 |
Deposit Date | Mar 11, 2021 |
Journal | Neural Computing and Applications |
Print ISSN | 0941-0643 |
Electronic ISSN | 1433-3058 |
Publisher | BMC |
Peer Reviewed | Peer Reviewed |
Volume | 30 |
Issue | 9 |
Pages | 2697-2708 |
DOI | https://doi.org/10.1007/s00521-017-2847-5 |
Keywords | Visual object tracking, Mean-shift, Level set, Attractor neural network model, Occlusion, System-on-chip |
Public URL | http://researchrepository.napier.ac.uk/Output/2752289 |
You might also like
Modelling nanoplasmonic device based on an off-shelf hybrid desktop supercomputing platform
(2013)
Presentation / Conference Contribution
Interactive Reading Using Low Cost Brain Computer Interfaces
(2017)
Presentation / Conference Contribution
A single chip system for sensor data fusion based on a Drift-diffusion model
(2018)
Presentation / Conference Contribution
Towards a scalable hardware/software co-design platform for real-time pedestrian tracking based on a ZYNQ-7000 device
(2018)
Presentation / Conference Contribution
A Highly Integrated Hardware/Software Co-Design and Co-Verification Platform
(2018)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search