» Data Orchestration System: Worked on building a serverless big data orchestration system that pulls large amount of data from various sources and then filters and enriches the data based on various rules defined in the rule-engine and also based on some third party apis.
AWS Infra Used - ECS, Lambda, EMR, Step function, SQS, SNS, S3
Tools/Language - Java, Scala, ReactJS, DynamoDB

» Optimisations & Improvements - :

• Optimised the rules that are fed to rule engine, which led to a 22% increase in processing speed.
• Optimised the CPU utilisation of EMR by migrating it to a server-less setup.
• Made load test to be more resilient by implementing a auto-scaling strategy on the infrastructure.

» Loan Documents Review System - Created a system for customers to upload documents for personal loans and agent can review the same before sending to bank
» Cross sub-domain local storage access - An internal NPM package that allows access of local-storage across all sub-domains, which is not usually possible.

» RESTful Services - Created multiple services for features like data files upload/download, bulk csv data import etc.
» AWS S3 SDK - Migrated from file system storage to AWS S3
» Task scheduler - Task scheduler for sending emails, uploading S3 files, and DB data updation for legacy services.
» Data Visualization - Dashboard for representing data using charts and graphs on the landing page of the application.

» RESTful APIs: Worked on several CRUD APIs used for updating data in the database.
» DB Query Optimization: Optimised SQL query in complex data extraction services.
» Charts in Reports: Build several charts for data Visualization in web based reports in JavaScript.

» Scripts for data fix - NodeJS and Python scripts for automated data fixes in DB and generating report.
» SQL queries reports - Highly optimised SQL qeries for data fetching from OLAP db server.
» Swagger documentation - Documented apis in openApi format to generate automated swagger APIs.