Repository files navigation

TheSpatial Framework for Hadoop allows developers and data scientists to use the Hadoop data processing systemfor spatial data analysis.

For tools,samples, andtutorials that use this framework, head overtoGIS Tools for Hadoop.

• GeoJSON support: Hadoop InputFormat and Hive SerDe for GeoJSON as well as for Esri GeoServices REST JSON (in v1.2.0 release).
• ST_Geometry works under SparkSQL as well as under Hive itself (the new part is the JSON SerDe classes working under SparkSQL - pretty much everything else had already worked).

• JSON Utilities - Utilitiesfor interacting with JSON exported from ArcGIS
• Javadoc
• Hive Spatial - User-DefinedFunctions and SerDes for spatial analysis in Hive
• UDF Documentation
• JSON SerDe

Build as you would any other Mavenized repository. All dependencies are pulled automatically.

Ant build files are also available

At the root level of this repository, you can build a single jar with everything in the frameworkusingApache Ant. Alternatively, you can build a jar at the root level of eachframework component (i.e.,hive/build.xml).

The build files useMaven Ant Tasks for dependencymanagement. You will need the jar in a place Ant can find it (i.e.,~/.ant/lib/maven-ant-tasks-2.1.3.jar).

• Esri Geometry API for Java - Java geometry library for spatial dataprocessing.

• Hive 0.9.0 and above (seeHive Compatibility issues)
• Workflows calling MapReduce jobs require the location of the custom job to be run.
• Custom MapReduce jobs that use the Esri Geometry API require that the developer has authored the job,(referencing the com.esri.geometry.* classes), and deployed the job Jar file to the Hadoop system, prior to theArcGIS user submitting the workflow file.

• GeoData Blog on the ArcGIS Blogs
• Big Data Place on GeoNet
• ArcGIS Geodata Resource Center
• ArcGIS Blog
• twitter@esri

Find a bug or want to request a new feature? Please let us know by submitting an issue.

Esri welcomes contributions from anyone and everyone. Please see ourguidelines for contributing

Copyright 2013-2017 Esri

Licensed under the Apache License, Version 2.0 (the "License");you may not use this file except in compliance with the License.You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, softwaredistributed under the License is distributed on an "AS IS" BASIS,WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.See the License for the specific language governing permissions andlimitations under the License.

A copy of the license is available in therepository'slicense.txt file.