Home > Research > Publications & Outputs > Single Satellite Imagery Simultaneous Super-res...
View graph of relations

Single Satellite Imagery Simultaneous Super-resolution and Colorization using Multi-task Deep Neural Networks

Research output: Contribution to journalJournal article

E-pub ahead of print
<mark>Journal publication date</mark>2/03/2018
<mark>Journal</mark>Journal of Visual Communication and Image Representation
<mark>State</mark>E-pub ahead of print
Early online date2/03/18
<mark>Original language</mark>English


Satellite imagery is a kind of typical remote sensing data, which holds preponderance in large area imaging and strong macro integrity. However, for most commercial space usages, such as virtual display of urban traffic flow, virtual interaction of environmental resources, one drawback of satellite imagery is its low spatial resolution, failing to provide the clear image details. Moreover, in recent years, synthesizing the color for grayscale satellite imagery or recovering the original color of camouflage sensitive regions becomes an urgent requirement for large spatial objects virtual reality interaction. In this work, unlike existing works which solve these two problems separately, we focus on achieving image super-resolution (SR) and image colorization synchronously. Based on multi-task learning, we provide a novel deep neural network model to fulfill single satellite imagery SR and colorization simultaneously. By feeding back the color feature representations into the SR network and jointly optimizing such two tasks, our deep model successfully achieves the mutual cooperation between imagery reconstruction and image colorization. To avoid color bias, we not only adopt the non-satellite imagery to enrich the color diversity of satellite image, but also recalculate the prior color distribution and the valid color range based on the mixed data. We evaluate the proposed model on satellite images from different data sets, such as RSSCN7 and AID. Both the evaluations and comparisons reveal that the proposed multi-task deep learning approach is superior to the state-of-the-art methods, where image SR and colorization can be accomplished simultaneously and efficiently.

Bibliographic note

This is the author’s version of a work that was accepted for publication in Journal of Visual Communication and Image Representation Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Journal of Visual Communication and Image Representation, ??, ?, 2018 DOI: 10.1016/j.jvcir.2018.02.016