Forget about the new data trends in 2023! This fundamental data engineering challenge is still not solved. — It is 2023! New data paradigms (or buzz words) like ELT, reverse ETL, EtLT, Data mesh, Data contracts, FinOps and modern data stack found their way into mainstream data conversations. Our data teams are still figuring out what is hype and what is not. There may be 10 new paradigms…

Stop chasing the recruiters and let the recruiters come to you! Before you read: The post is tailored to job seekers on LinkedIn and not all points may be relevant for someone building personal brand or thought leadership. Before jumping straight into modifying your LinkedIn profile, check how is it doing currently. Has…

Debunking the myths in 5 minutes!! chatGPT flooded the internet this week! Students are excited to make it write their assignments. Marketing folks are wary of GPT taking away their jobs. Engineers are thrilled to make it write code snippets, documentation and what not! Everyone is trying their hands at…

Opening up black-box machine learning models with Explainable AI (XAI) — What is Explainable AI (XAI)? “My dog accidentally knocked down the trash and found old cheesy pasta in it, and is now convinced that trash cans provide an endless supply of cheesy pasta, knocking it over every chance she gets.” Sometimes, you would have seen your Machine Learning(ML) model do the same too. A notorious…

Step by step guide to help you get into junior DE roles in 30 days! Zach’s post is definitely comprehensive. But for an absolute beginner to data engineering, it might be slightly intimidating. For absolute beginners: Here is what I would start with: SQL — At least intermediate level SQL (Self Joins, Groupby…

Here are the resources to get you started! Statistics & Probability Beginner: Khan Academy — Statistics: https://www.youtube.com/playlist?list=PL1328115D3D8A2566 Khan Academy — Probability: https://www.youtube.com/playlist?list=PLC58778F28211FA19 StatQuest — Statistics: https://www.youtube.com/watch?v=qBigTkBLU6g&list=PLblh5JKOoLUK0FLuzwntyYI10UQFUhsY9 Advanced: Intro to probability and statistics MIT 18.05: https://ocw.mit.edu/courses/mathematics/18-05-introduction-to-probability-and-statistics-spring-2014/

A simple 3-step approach that attracted 90+ recruiters and hiring managers! By simply working on my LinkedIn profile over the last month, I was able to receive 90+ InMails from recruiters and hiring managers. It is my data-driven approach that resulted in such good numbers. Read along as I break…

Question everything! Answer with data! — Background about the Ad: Paytm conducted a social experiment on International Women’s day about the big divide in financial literacy between women and men. A total of 30 people — 15 men and 15 women — participated in the experiment. If you haven’t watched the ad, here you go: https://www.youtube.com/watch?v=F9CLFiPnOd8 The Ad went viral…

You can practice Hadoop, Spark and Hive for free in AWS. — Hadoop is a framework for processing big data in a distributed environment. Hadoop cluster is a group of nodes (say Virtual Machines or Containers) — one master node and remaining worker nodes — that distribute the data among themselves and process them in parallel. Why create a cluster in AWS? Why not in your local machine? All the big data frameworks and…