azkaban

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

workflow airflow spark hive hadoop kettle hue tableau flink zeppelin griffin atlas azkaban governance davinci visualis supperset linkis dolphinscheduler dataworks

UpdatedMar 13, 2025
Java

DTStack /Taier

Star1.2k

Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

spark hive hadoop scheduler job-scheduler flink dag cronjob-scheduler azkaban distributed-schedule-system workflow-scheduling-system task-schedule data-schedule chunjun

UpdatedAug 7, 2024
Java

WeBankFinTech /Schedulis

Star392

Schedulis is a high performance workflow task scheduling system that supports high availability and multi-tenant financial level features, Linkis computing middleware, and has been integrated into data application development portal DataSphere Studio

workflow scheduler azkaban linkis qualitis datasphere-studio schedulis wedatasphere

UpdatedMar 12, 2025
Java

233zzh /TitanDataOperationSystem

Star124

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

kafka spark hive hadoop flume azkaban

UpdatedNov 8, 2021
JavaScript

cocofree /azkaban_assistant

Star119

azkaban小助手,增加任务web配置、远程脚本调用、报警扩展、跨项目依赖等功能。

azkaban

UpdatedApr 24, 2017
Python

tlhhup /litemall-dw

Star111

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

shell redis vagrant scala kafka spark spring-boot lua hive clickhouse hbase openresty ranger flume oozie flink atlas azkaban maxwell cdh6

UpdatedMay 16, 2022
Java

mtth /azkaban

Star77

Lightweight Azkaban client

python azkaban

UpdatedJan 28, 2020
Python

Wanfengyueluo /BookRecommenderSystem

Star54

UpdatedDec 8, 2021

thestyleofme /common-datax

Star53

基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步

redis hive freemarker mybatis azkaban mybatis-plus datax springboot2 dynamic-datasource

UpdatedJun 21, 2022
Java

apache /dolphinscheduler-operator

Star27

Apache DolphinScheduler Kubernetes Operator.

airflow schedule job-scheduler oozie task-scheduler azkaban distributed-schedule-system workflow-scheduling-system etl-dependency workflow-platform cronjob-schedule job-schedule task-schedule workflow-schedule data-schedule

UpdatedDec 18, 2023
Go

leoChaoGlut /ambari-azkaban-service

Star25

Ambari service for Azkaban

big-data bigdata ambari azkaban ambari-azkaban

UpdatedAug 29, 2021
Shell

Renien /ETL-Starter-Kit

Star21

📁 Extract, Transform, Load (ETL) 👷 refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.

scala hive gradle bigdata datascience pig scalding azkaban datamining starter-project etl-framework mapreduce-jobs