sqoop

Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources

etl flink sqoop datax linkis dataspherestudio exchangis transmission-engine wedatasphere

UpdatedApr 25, 2025
Java

bluishglc /bdp

Star199

A prototype project of big data platform, the source codes of the book Big Data Platform Architecture and Prototype

redis demo kafka spark prototype bigdata spark-streaming quickstart sparksql oozie sqoop spark-sql spark-streaming-examples sqoop-import spark-demo middle-end middle-office spark-examples

UpdatedAug 12, 2020
Java

aliyun /aliyun-maxcompute-data-collectors

Star130

bigdata kettle ogg flume sqoop aliyun-maxcompute

UpdatedMay 21, 2025
Java

Pushkr /Apache-Spark-Hands-On

Star87

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

spark hive hadoop bigdata cloudera handson cheatsheet flume basics sqoop cca175

UpdatedJan 22, 2019
Python

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.

airflow kafka spark cassandra hive hadoop schema-registry postgresql python3 pyspark hdfs flume hue zeppelin pgadmin4 kadmin sqoop conda-environment control-center

UpdatedFeb 27, 2023
Shell

Mrkuhuo /bigdata_learning

Star57

大数据组件学习代码

python java elasticsearch spark hive hadoop clickhouse hbase flink sqoop iceberg datax cdh5 doris hudi dolphinscheduler

UpdatedMay 6, 2024
Java

vivek2319 /Learn-Hadoop-and-Spark

Star54

This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

apache-spark yarn hive hadoop bigdata impala hbase pig apache-storm mapreduce flume oozie apache-kafka sqoop apache-solr hadoop-filesystem apache-ranger hiveql apache-atlas apache-knox

UpdatedJun 10, 2018
Python

dimajix /spark-training

Star54

Repository used for Spark Trainings

python scala spark hive hadoop pyspark spark-streaming sqoop spark-ml hadoop-training spark-training

UpdatedApr 21, 2023
Jupyter Notebook

v5tech /cloud

Star54

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

hive hadoop hbase zookeeper pig flume oozie hue sqoop flume-ng

UpdatedApr 25, 2017
Shell

maniram-yadav /Big_DataHadoop_Projects

Star51

Big data projects implemented by Maniram yadav

spark hive hadoop pig hdfs mapreduce flume pig-latin sqoop hadoop-mapreduce big-data-analytics hadoop-hdfs big-data-projects

UpdatedMay 5, 2018
PigLatin

Cigna /ibis

Star50

IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

workflow hadoop ingestion oozie sqoop sqoop2 workflow-automation workflow-scheduler hadoop-ecosystem hadoop-framework ibis cigna

UpdatedApr 13, 2022
Python

tejasjbansal /HELTHCARE-SYSTEM

Star48

Data cleaning, pre-processing, and Analytics on a Health care data using Spark and Python.

python big-data spark hive sqoop spark-sql big-data-projects

UpdatedJul 19, 2023
Jupyter Notebook

san089 /Cloudera_Material

Star37

Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

big-data spark hive hadoop bigdata cloudera pyspark cca flume certification sqoop cca175 hive-metastore sqoop-session sqoop-export sqoop-import

UpdatedApr 21, 2020

Powerspace /pg2bq

Star37

Export PostgreSQL tables to Google BigQuery

bigquery postgresql gcloud sqoop

UpdatedJun 14, 2021
Scala

ven2day /Bigdata-docker-sandbox

Star30

Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary tools that can be used in the BigData domain, It's a collection of docker containers that you can use directly.

mysql mongo kafka spark hive hadoop storm hbase zookeeper metabase hue nifi flink sqoop streamsets