Dataset Guide

Dataset: SparkRS - Spark for Remote Sensing, Phase I
Provided by National Aeronautics and Space Administration
Updated 12 Nov 2020

On this page: Summary | Resources | Preview | Get the dataset | Explore related

Dataset summary

The dataset on this page is a cache of the dataset It is a snapshot of the dataset as it appeared on 06 Jun 2021 17:44 GMT. The current dataset could have changed in the meantime. Attribution: Contains data retrieved from

The proposed innovation is Spark-RS, an open source software project that enables GPU-accelerated remote sensing workflows in an Apache Spark distributed computing cluster. Current state-of-the-art parallel systems like Hadoop and Spark offer horizontally scalable analytics and reduced costs for enterprises, but weren't built to natively consume and process large remote sensing raster datasets. Conversely, GPUs can vastly accelerate image processing operations. Some open source projects have arisen that showcase hybrid Hadoop/GPU computing. However, there are no mature open source projects that utilize GPUs within Spark (an eventual replacement of MapReduce) and none that were built to process large remote sensing imagery. This is the primary role of the proposed innovation, Spark-RS. Spark-RS contains three primary components. One is a parallel large image loading component that quickly loads large multi-band imagery into a Spark cluster. The second component is a remote sensing libra...

Dataset:SparkRS - Spark for Remote Sensing, Phase I
Provider:National Aeronautics and Space Administration
Licence:License information is derived automatically. Refer to source for license information before using this data.
License not specified
Country:United States of America

Dataset resources

"SparkRS - Spark for Remote Sensing, Phase I" contains the following resources:


Previews are not currently available for this dataset.

Get the dataset

Explore related datasets

Find other datasets by National Aeronautics and Space Administration.

Search datasets: