Implementation of a Bio-Inspired Neural Architecture for Autonomous Vehicles on a Multi-FPGA Platform - ETIS, équipe de recherche CELL Accéder directement au contenu
Article Dans Une Revue Sensors Année : 2023

Implementation of a Bio-Inspired Neural Architecture for Autonomous Vehicles on a Multi-FPGA Platform

Implémentation d'une architecture neurale bio-inspirée pour véhicules autonomes sur plate-forme multi-FPGA

Résumé

Autonomous vehicles require efficient self-localisation mechanisms and cameras are the most common sensors due to their low cost and rich input. However, the computational intensity of visual localisation varies depending on the environment and requires real-time processing and energy-efficient decision-making. FPGAs provide a solution for prototyping and estimating such energy savings. We propose a distributed solution for implementing a large bio-inspired visual localisation model. The workflow includes (1) an image processing IP that provides pixel information for each visual landmark detected in each captured image, (2) an implementation of N-LOC, a bio-inspired neural architecture, on an FPGA board and (3) a distributed version of N-LOC with evaluation on a single FPGA and a design for use on a multi-FPGA platform. Comparisons with a pure software solution demonstrate that our hardware-based IP implementation yields up to 9× lower latency and 7× higher throughput (frames/second) while maintaining energy efficiency. Our system has a power footprint as low as 2.741 W for the whole system, which is up to 5.5–6× less than what Nvidia Jetson TX2 consumes on average. Our proposed solution offers a promising approach for implementing energy-efficient visual localisation models on FPGA platforms.
Fichier principal
Vignette du fichier
sensors-23-04631.pdf (2.75 Mo) Télécharger le fichier
Origine : Publication financée par une institution

Dates et versions

hal-04140476 , version 1 (22-01-2024)

Licence

Copyright (Tous droits réservés)

Identifiants

Citer

Tarek Elouaret, Sylvain Colomer, Frédéric de Melo, Nicolas Cuperlier, Olivier Romain, et al.. Implementation of a Bio-Inspired Neural Architecture for Autonomous Vehicles on a Multi-FPGA Platform. Sensors, 2023, 23 (10), pp.4631. ⟨10.3390/s23104631⟩. ⟨hal-04140476⟩
38 Consultations
7 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More