python ETL framework

Implementation of an ETL process for real-time sentiment analysis of tweets with Docker, Apache Kafka, Spark Streaming, MongoDB and Delta Lake

This project repository provides a headless module to enrich location data in a database table using the Google Maps Geocode API.

Sugar candy for data scientist. Easy manipulation in time-series data analytics works.

Dynamic website scraper and email notifier.

Scraping BooksToScrape (P2 OC D-A Python) : Utiliser les bases de Python pour l'analyse de marché

I made various data normalization operations with python scripts. Target data in CSV format

This repository hosts a collection of Python scripts designed to work with ETL jobs.

A simple, reusable, templates based ETL (Extract, Transform and Load) library and framework written in Python

ETL : Extract --> transform --> load

Data Processor

Your one-stop destination for managing budgets and gaining financial insights

This repository contains code for building a Data Warehouse from scratch. I started with the elicitation process, then used functional dependencies for conversion to GOM4DW schema, followed by conversion to Star Schema to find out different facts and dimensions and lastly I implemented the ETL process. I have used HTML and flask to provide a use…

PyQt5 app for JSON parsing and ETL processing

Alrogoritimo de detecção sinonímia, feito na disciplina de Estruturas de dados.

A recommender system for video games! The Video Game Recommender (VGR) project was created as an university project at the Westfälische Wilhelms-Universität Münster, as part of the Data Integartion Module in the Information Systems master programme.

Processo de ETL e visualização de dados utilizando a Spotify Web API

Dataset cleaned and queried to visualisation for HR Employee data report. Skills: PowerBI, MySQL, EDA, ETL

This repository showcases my university "Laboratory of Data Science" project. It encompasses the implementation of a data warehouse, ETL process, Data Cube, MDX queries, and an interactive dashboard.

Air Quality ETL is a Python repository facilitating the extraction, transformation, and loading of air quality data from RapidAPI to a Pandas DataFrame for easy analysis and customization.