SELECT * FROM my_thoughts WHERE topic='Introduction'
IntroductionJanuary 28, 2025

SELECT * FROM my_thoughts WHERE topic='Introduction'

Welcome to my digital mind-space! If you've stumbled upon this corner of the internet, you're probably interested in tech, data, or just curious about what I have to say. Either way, I’m excited to have you here. And yes, that's my attempt at a data guy's version of "Hello World."

Who Am I?

I’m Mohamed Shoaib—an IT analyst by profession and a software engineer at heart. Currently attempting to unravel the exciting world of Big Data and Analytics, one step at a time - a space that’s as vast as the data itself.

Why Big Data?

If you are wondering—why Big Data? What sparked my curiosity in this niche?

For me, it all started with the realization that data is everywhere. Every app we use, every click, every transaction, every interaction—it's all data. And hidden within all that information are powerful insights waiting to be discovered.

I was especially intrigued to learn how companies leverage data to drive decisions, predict trends, and create better user experiences. The ability to take raw, unstructured data and transform it into something meaningful felt like a superpower. So, I've decided to explore this field, one project at a time.

Why Data Engineering?

As I explored the shores of Big Data, I quickly realized that collecting and analyzing data is only part of the equation—before any insights can be derived, data needs to be processed, structured, and made accessible. That’s when I discovered Data Engineering.

As a software engineer, I’ve always loved the process of building—turning ideas into functional solutions. That passion for building is what drew me to Data Engineering. Just like in software development, Data Engineering involves designing, constructing, and optimizing systems—but instead of applications, it's data pipelines, infrastructure, and workflows that power downstream analytics and decision-making. It’s the perfect blend of engineering and problem-solving, and that’s what excites me about this field.

What to Expect?

They say the faintest ink is better than the strongest memory, and I couldn't agree more. This isn't a blog by a seasoned data engineer showing you production-ready solutions (at least not yet). Instead, this is my way of documenting my journey—learning, building, and sharing as I go.
Here's what I plan to write about in this blog in the future:

  • Tools and Technologies I learn
  • Projects I Build
  • Share resources, tutorials and insights that maybe useful
  • And most importantly, mistakes — this is a space for growth, and I hope my experiences may help someone, somewhere, someday.

Closing Thoughts

As I take my first steps into the world of Data Engineering, I feel equal parts excited, anxious, and nervous. There’s so much to learn, so many tools to explore, and an endless number of ways to solve problems. But that’s what makes this journey thrilling!

I remind myself that every expert was once a beginner, and every complex data pipeline started with a simple "SELECT * FROM table".The key is to keep building, keep learning, and keep pushing forward—one project at a time.

So, if you’re also on a similar path or just curious about the world of Big Data, I’d love for you to join me. Let’s learn, build, and grow together!

P.S.: If you're wondering about the frequency of posts—I plan to write whenever I build something interesting or learn something worth sharing. Quality over quantity!