I'm an IT Professional with a passion for developing scalable, secure, and high-performance systems. I specialize in Software Development, Cloud Computing, and Data Engineering. I love solving complex problems, optimizing processes, and driving technology innovation. π
- Python | Java | JavaScript | SQL | Bash
- AWS | Azure
- PostgreSQL | MySQL | Snowflake | Redshift
- Hadoop | Apache Spark | Hive | Sqoop | AWS Services | Azure Services | Apache Airflow | Snowflake
- Git | GitHub | GitLab
- Building scalable Data Pipelines and ETL solutions using Cloud Services.
- Developing Cloud-native microservices for modern architectures.
- Implementing CI/CD pipelines for seamless automated data pipelines.
- Exploring Machine Learning and Data Analytics for business insights.
-
Reddit ETL Pipeline (Apache Airflow + AWS ) : A scalable ETL solution for processing Reddit data into Amazon Redshift.
-
Exchange Rate Pipeline (AWS + Snowflake) : A robust ETL pipeline designed to automate the process of fetching, transforming, and storing real-time exchange rate data from various global financial APIs into a cloud-based database for analytics and reporting.
-
End-to-End Azure Data Engineering Project: A comprehensive ETL pipeline built on Azure Databricks, Azure Data Factory, and Azure Logic Apps to process, transform, and store data from various sources (CSV, XLSX, JSON, PostgreSQL, APIs) using Medallion Architecture for structured and analytics-ready data.
- LinkedIn: LinkedIn Profile
- Email: [email protected]
I'm always open to new opportunities, collaborations, and learning from other like-minded professionals. Feel free to reach out if you'd like to discuss exciting projects or exchange ideas!
- Working on Project-X: A cloud-based solution to automate data ingestion and analytics.
- Cloud Infrastructure: Architected and deployed applications on AWS using Glue, S3, Lambda, Athena, Redshift and More.
- Data Engineering: Built high-performance data pipelines with Apache Airflow , Azure and AWS.
- Automation: Automated cloud infrastructure provisioning using Azure , AWS and Big Data Tools pipelines.
"Strive for progress, not perfection."