Dataset: SparkRS - Spark for Remote Sensing, Phase I
Provided by National Aeronautics and Space Administration
Updated 12 Nov 2020
On this page: Summary | Resources | Preview | Get the dataset | Explore related
Dataset summary
The dataset on this page is a cache of the dataset https://catalog.data.gov/dataset/sparkrs-spark-for-remote-sensing-phase-i. It is a snapshot of the dataset as it appeared on 06 Jun 2021 17:44 GMT. The current dataset could have changed in the meantime. Attribution: Contains data retrieved from Data.gov.
The proposed innovation is Spark-RS, an open source software project that enables GPU-accelerated remote sensing workflows in an Apache Spark distributed computing cluster. Current state-of-the-art parallel systems like Hadoop and Spark offer horizontally scalable analytics and reduced costs for enterprises, but weren't built to natively consume and process large remote sensing raster datasets. Conversely, GPUs can vastly accelerate image processing operations. Some open source projects have arisen that showcase hybrid Hadoop/GPU computing. However, there are no mature open source projects that utilize GPUs within Spark (an eventual replacement of MapReduce) and none that were built to process large remote sensing imagery. This is the primary role of the proposed innovation, Spark-RS. Spark-RS contains three primary components. One is a parallel large image loading component that quickly loads large multi-band imagery into a Spark cluster. The second component is a remote sensing libra...
Dataset: | SparkRS - Spark for Remote Sensing, Phase I |
Provider: | National Aeronautics and Space Administration |
Created: | 12/11/2020 |
Updated: | 12/11/2020 |
Licence: | License information is derived automatically. Refer to source for license information before using this data. notspecified License not specified |
Country: | United States of America |
Dataset resources
"SparkRS - Spark for Remote Sensing, Phase I" contains the following resources:
html - SparkRS - Spark for Remote Sensing, Phase ITechport Project Page
html - SparkRS - Spark for Remote Sensing, Phase ITechport Project JSON Metadata
html - SparkRS - Spark for Remote Sensing, Phase ITechport Project XML Metadata
html - SparkRS - Spark for Remote Sensing, Phase ITechport Project PDF Export
Preview
Previews are not currently available for this dataset.
Get the dataset
catalog.data.gov
Explore related datasets
Find other datasets by National Aeronautics and Space Administration.
Search datasets: