A1 Refereed original research article in a scientific journal

Can citizen science and social media images support the detection of new invasion sites? A deep learning test case with Cortaderia selloana




AuthorsCardoso Ana Sofia, Malta-Pinto Eva, Tabik Siham, August Tom, Roy Helen E., Correia Ricardo, Vicente Joana R., Vaz Ana Sofia

PublisherElsevier

Publication year2024

JournalEcological Informatics

Journal name in sourceEcological Informatics

Article number102602

Volume81

ISSN1574-9541

eISSN1878-0512

DOIhttps://doi.org/10.1016/j.ecoinf.2024.102602

Web address https://doi.org/10.1016/j.ecoinf.2024.102602

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/387737982


Abstract
Deep learning has advanced the content analysis of digital data, unlocking opportunities for detecting, mapping, and monitoring invasive species. Here, we tested the ability of open source classification and object detection models (i.e., convolutional neural networks: CNNs) to identify and map the invasive plant Cortaderia selloana (pampas grass) in mainland Portugal. CNNs were trained over citizen science images and then applied to social media content (from Flickr, Twitter, Instagram, and Facebook), allowing to classify or detect the species in over 77% of situations. Images where the species was identified were mapped, using their georeferenced coordinates and time stamp, showing previously unreported occurrences of C. selloana, and a tendency for the species expansion from 2019 to 2021. Our study shows great potential from deep learning, citizen science and social media data for the detection, mapping, and monitoring of invasive plants, and, by extension, for supporting follow-up management options.

Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on 2024-26-11 at 12:24