Ishan
I'm a Toronto based Senior Data Engineer with a background in Data Engineering and Statistics.🤓 . I have extensive experience designing end-to-end solutions from Algorithms, ETL pipelines and Big Datasets to optimize workflows and big data challenges in the financial space.🤖
Experience
RBC
Senior Data Engineer
Focused on orchestrating big data pipelines on Snowflake and building Gen AI usecases for GLobal Wealth Customers.
Senior Data Engineer
Leverage wealth management data to execute ETL and ELT processes on Snowflake, meticulously reviewing query plans and crafting insightful Tableau dashboards. Additionally, I specialize in data science analysis, overseeing the migration of millions of records with DBT and Airflow while delving into cutting-edge Gen AI initiatives, statistical analyses, and machine learning applications.
Scotiabank
Senior Data Engineer
Focused on processing big datasets and data analytics support to teams - Global Business Payments, Credit Risk in Carribean, Peru, Canada & US.
Senior Data Engineer
I am responsible for the improvement of SQL and No-Sql queries. Moreover, Analyzing the big data-sets(~100GB per day) and detect fraud transactions. Apart from that, Created various automation tools using python, airflow, JS and reduced 4000 manual hours.
Scotiabank
Data Scientist
Analyzed datasets to catch Fraud transcations. Supported AML/ATF, Global Business Market, Global Wealth & Cyber security teams.
Data Scientist
Responsible for parsing SWIFT transactions for AML/ATF purposes using Python and R. Moreover, focused heavily on source to target data validation, & completeness testing. Focused on creating models using scikit-learn and nltk. Created and automated ~25 production-ready power BI dashboards
Hydra
Data Solution Partner
Assisting new or existing Hydra Customers with data warehouse implementation, analytics, and reporting services.
Data Solution Partner
Responsible for ETL to a Hydra data warehouse by linking open source services like airflow, data build tool, airbyte and many-more to completely automate the pipelines for retention metrics, visualizations etc. Moreover, responsible for the data migration from public clouds to hydra. Also, provide assistance with query optimizations.
Sanau
Full-Stack Developer
Responsible for deploying automated sub-domains on the internet using Docker and AWS in the Start-up to support small businesses.
Full-Stack Developer
My key responsibilty was to use Route53 service on AWS and automated the deployment of MERN stack. Moreover, I learned designing docker files for scalability and for high performance. Reduced Production website loading time by 100ms using Gzip compression and Cloudflare
Park2Sky
Web Developer
Responsible for designing, coding and maintaining websites and databases for customers to manage vehicle bookings.
Web Developer
Here, I deep expertise and hand on experience with Web Applications and programming languages such as HTML, CSS, JavaScript, PHP, JQuery and API's. Furthermore, I am responsible for managing RESTful Services and develop knowledge of Search Engine Optimization(SEO).
Techrangle
Developer
Responsible for managing Azure cloud VM machines and web-server - Nginx to provide web traffic data to the Elasticsearch index's.
Developer
Managed production-level Nginx web server. Moreover, resolved production level Ubuntu server's OS to resolve application port issues using port-forwarding and proxies. Managing the elasticsearch index's and analyzed the data using Kibana
About Me
I was born and raised in India. After completing my high school, I moved to Toronto, CA to pursue my Bachelors, and have lived here since then.
Outside of work, I enjoy configuring and networking servers and deploying services such as Grafana, Prometheus, Hadoop, Trino, and more. I like to learn technical or non-technical skills during my free time. I can also solve a Rubik's cube in under 1.5 minutes and learning competitive chess.
Education
B.Tech in Software Engineering Technology
McMaster University, Hamilton, Canada
Year Graduated: 2024
Adv Diploma in Software and Network Engineering
Sheridan College, Brampton, Canada
Year Graduated: 2020 [Honours]
Additional Information
Programming Languages: Python, SQL (Standard SQL/ Oracle / PostgreSQL / Sybase), R, Java, Bash, Powershell, CSS, HTML, Git
Most Used Tools: PowerBI, Pycharm, Jupyter Notebook, Spyder, Oracle SQL Developer, Sql Server Management Studio, CLI, Microsoft Azure, BigQuery Datawarehouse, Alteryx
Skills
Analytics Tools
-
PowerBI90%
-
Kibana85%
-
Grafana80%
Cloud Platforms
-
GCP85%
-
AWS80%
-
Azure75%
-
Cloudflare75%
DevOps
-
Docker95%
-
Bitbucket90%
-
GitHub80%
-
JIRA90%
-
Jenkins70%
-
Maven80%
-
Gradle85%
Databases
-
Oracle85%
-
Sybase80%
-
MariaDB80%
-
Microsoft SQL80%
-
MySQL90%
-
Microsoft Access50%
-
SQLite90%
-
Mongo90%
-
Postgres90%
Languages
-
Python97%
-
R90%
-
Java90%
-
C#87%
-
JavaScript80%
-
C70%
-
Objective C60%
-
Swift80%
-
PHP80%
-
HTML & CSS 89%
-
XML90%
-
GraphQL90%
Big Data Tools/Services
-
Trino85%
-
Apache Rancher75%
-
Apache Hadoop90%
-
Apache Hive90%
-
Apache Spark80%
-
Apache Cassandra90%
-
Apache Airflow80%
-
Presto80%
-
Teradata85%
-
Scala70%
-
Databricks80%
-
Snowflake85%
-
Elasticsearch90%
Projects
Project's | Live. RealTime.
ChatGPT Bot
Introducing a Streamlit Cloud-deployed ChatGPT-like chatbot powered by OpenAI's GPT-4.0 Turbo and GPT-3.5 Turbo models. Hosted on a private server and exposed via Cloudflare Tunnel.
IntelliReceipt
OCR Project using OpenCV, Tesseract and EasyOCR to process Retailer Receipts implemented with FastAPI, WSGI (Gunicorn) & Docker hosted in Cloudflare.
Chat App
NodeJs Real Time Web Application built with Socket.io and Express, which is powered by Docker.
Awards and Certification
Azure Certified Data Scientist
validates the skills and knowledge to apply Azure’s machine learning techniques to train, evaluate, and deploy models that solve business problems.
Authenticate Badge
Employee of the Year 2022 - Scotiabank
"Best of the Best Award" - Top Individual Performance
Pdf View
Azure Certified Data Engineer
Have a solid knowledge of data processing languages, such as SQL, Python, or Scala, and able to understand parallel processing and data architecture patterns.
Authenticate Badge
MongoDB Associate Developer
Have hands-on experience completing day-to-day operational tasks needed to use MongoDB.
Authenticate Badge
Apache Airflow Developer
can demonstrate the fundamental skills needed to effectively create, manage and monitor DAGs on Apache Airflow.
Authenticate Badge
Power BI Business Analytics Workshop - Microsoft
Completed workshop provided by Microsoft at Scotiabank for Business Analytics using Power BI.
Software Testing - Visual Studio
Earned Software Testing with Visual Studio Certification for managing test executions.
Comp TIA Linux+ LPI: System Architecture
Achieved Comp TIA Linux+ System Architecture Certification.
National Genius Search Foundation
Qualified and Achieved State-Level Rank all over India, held by 'NGSF'.
International Mathematics Olympiad
Earned rank of 5,636 globally in Mathematics Problem Solving Ability Test.
Want to get in touch?
Drop me a message!
Send your message below or email me at [email protected] to get immediate response.