- Notifications
You must be signed in to change notification settings - Fork161
Open
Labels
Description
Test the Spatial Framework for Hadoop UDFs fully integrated with Hive - automated and against multiple Hive versions.
Some time ago, PDK tests were obsoleted, after which:
- Thequery-level tests are not automated, require installation of Hive, and run only against the installed version of Hive.
- Theautomated API unit tests can easily run against different Hive (and Hadoop) versions with Maven profiles, but are incomplete and do not test at query level integrated with Hive.
Re Hive mini-cluster:
- https://cwiki.apache.org/confluence/display/Hive/Unit+Testing+Hive+SQL
- https://github.com/sakserv/hadoop-mini-clusters#hiveserver2-example
- https://stackoverflow.com/questions/16719541/integration-testing-hive-jobs
- https://github.com/apache/hive/blob/master/hcatalog/core/src/test/java/org/apache/hive/hcatalog/MiniCluster.java
- https://julienletrouit.com/?p=384