A prototype project of big data platform, the source codes of the book Big Data Platform Architecture and Prototype

• UpdatedAug 12, 2020
• Java

Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

• UpdatedApr 21, 2020

This is the first project where we worked on apache spark, In this project what we have done is that we downloaded the datasets from KAGGLE where everyone is aware of, we have downloaded loan, customers credit card and transactions datasets . After downloading the datsaets we have cleaned the data . Then after by using new tools and technologies…

• UpdatedOct 14, 2021
• Jupyter Notebook

BigData Engineering Capstone Project with Tech-stack : Linux, MySQL, sqoop, HDFS, Hive, Impala, SparkSQL, SparkML, git

• UpdatedAug 25, 2022
• Python

Apache Sqoop tutorial

• UpdatedJun 7, 2019

MapReduce Job Development, RDDs Programming, Medical Data Management, Sales Analysis, And Efficient Data Integration For Big Data Analysis. Spark: Big Data Processing, SQOOP Integration, And Spark Structured Streaming For Real-Time Data.

• UpdatedJun 7, 2023
• Java

• UpdatedSep 5, 2019
• Shell

Built a data pipeline by creating tables in MySQL DB, ingested tables to Hadoop for data warehousing and built HiveQL views. Hive views in Linux VM were connected to Power BI application in Windows to create visualizations.

• UpdatedDec 5, 2023

Created a utility to import data from traditional databases to hdfs using sqoop and implemented using bash

• UpdatedJun 11, 2019
• Shell

• UpdatedMar 13, 2020

Real-Time & Batch Data Processing Pipeline

• UpdatedJan 12, 2020
• Python

Import data into the Hive using Sqoop.

• UpdatedOct 26, 2021

[Innopolis University] Big Data Course 2023. Final Project

• UpdatedMay 11, 2023
• HiveQL

This repository consists of the source code and the screenshots of the output. This project uses Hive, SQL, and Sqoop to perform analysis.

• UpdatedDec 5, 2021

heart data analysis

• UpdatedFeb 20, 2024
• Python

ETL Pipeline for Spar Nord Bank for the analysis of refilling frequency of the ATM's all over the europe

• UpdatedMay 7, 2024
• Jupyter Notebook

A python package that lets you sqoop into HDFS/Hive/HBase data from RDBMS using sqoop

• UpdatedApr 18, 2020
• Python

Build a data pipeline (using hadoop-hdfs, sqoop, hiveql) for data analysis out of an ambiguous and incomplete instruction.

• UpdatedMar 16, 2023

A query system for a hypothetical bank scenario

• UpdatedFeb 9, 2022
• HiveQL