Skip to content
View nis12ram's full-sized avatar
3 followers · 6 following
  • xyz

Achievements

Achievement: Pull Shark

Achievements

Achievement: Pull Shark

Block or report nis12ram

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
nis12ram/README.md

Hi there, I'm nishant! 👋

🎓 Aspiring Data Engineer

I’m working toward becoming a Data Engineer, with hands-on experience in building reliable data workflows and scalable pipelines.

🛠️ Technical Stack

  • Big Data: PySpark, Delta Lake.
  • Cloud Tools: Azure Data Factory (ADF), Azure Databricks, ADLS Gen2.
  • Programming: Python, SQL.

🚀 Projects

UnifiedSalesReportingPipeline

Designed and implemented an end-to-end Azure lakehouse pipeline to consolidate daily sales data from multiple regional branches.

  • Orchestration: Built modular, fault-tolerant workflows in ADF with centralized logging, retry logic, and restart-from-failure handling.
  • Transformation: Developed parameterized notebooks in Databricks for cleaning, normalization, and metadata enrichment.
  • Governance: Implemented data quality checks by quarantining invalid records and enforcing NOT NULL/CHECK constraints.
  • Storage: Wrote optimized, ACID-compliant Delta Lake tables on ADLS Gen.

Github Link

UnifiedSalesPipeline
agri-price-arbitrage-adf-pipeline

Built an ADF-driven pipeline to ingest and process daily agricultural commodity price data from external APIs.

  • Architecture: Utilized a Medallion (Bronze-Silver-Gold) architecture for structured data processing.
  • Data Flow: Cleaned and standardized nested JSON data using ADF Data Flows to ensure consistent schema and quality.
  • Analytics: Implemented business logic to identify in-state price arbitrage opportunities for actionable trading insights.

Github Link

agri_poster1

📚 TECHNICAL LEARNING & KNOWLEDGE SHARING

I enjoy documenting my Data Engineering learnings in simple, digestible explanations to improve my understanding.

Posts Website: DEDigest

Thanks for visiting my profile! Feel free to connect or check back soon for more updates.

Pinned Loading

  1. UnifiedSalesReportingPipeline UnifiedSalesReportingPipeline Public

    UnifiedSalesReporting is an Azure-based data engineering solution designed to automate the ingestion, transformation, and reporting of daily sales data from multiple regional branches

    Jupyter Notebook

  2. agri-price-arbitrage-adf-pipeline agri-price-arbitrage-adf-pipeline Public

    Azure Data Factory (ADF) pipeline for AgriBridge Commodities Limited to ingest and process daily agricultural price data. The pipeline identifies in-state commodity price arbitrage opportunities (p…

  3. ingestionPipelineADF ingestionPipelineADF Public

    clean, optimized and scalable ingestion pipeline in Azure Data Factory(ADF)

  4. sqlite3-vector-db sqlite3-vector-db Public

    a simple vector database built on top of sqlite3.

    Jupyter Notebook

  5. Transformer-and-attention-code Transformer-and-attention-code Public

    python code for building blocks of Transformers

    Jupyter Notebook

  6. in-browser-vector-db in-browser-vector-db Public

    JavaScript