the_dataengineer

u/the_dataengineer


r/dataengineering•

What are you guys looking for in a course nowadays?

What I'm seeing for the past year or so, is that people seem to not have the "stamina" to go through courses anymore. Many start, but fall off immediately. Simple courses people complain that they are too simple. More advanced courses, nobody takes them.

I feel like attention spans went down like crazy and people rather spend their time wrestling with AI than going through a well prepared project.

So what is it?

short lessons?,
prepared GitHub docs?
as much as hands-on as possible?
teaching basics instead of going into all the details?

My expectation would be to a good course helps people get to the point where they have

2734

r/dataengineering•

Hey guys, for a lot of people it feels super difficult to create data pipelines and data platforms. Too many focus on the tools right away and others immediately think about the coding.

The most important topic though, is to understand the data source and the goals you want / have to achieve. And for that you have to ask the right questions!

I created you a list of questions that will help. Let's see if I can just post all 81 here...

Let me know what you think and if I'm missing something important here 🙂

â–¶ Check out all 81 questions and more in my free Data Engineering Cookbook on GitHub: [https://github.com/andkret/Cookbook/blob/master/sections/03-AdvancedSkills.md#81-platform-and-pipe

10

r/dataengineering•

Hey everyone, Andreas here. I'm in Data Engineering since 2012. Build a Hadoop, Spark, Kafka platform for predictive analytics of machine data at Bosch.

Started coaching people Data Engineering on the side and liked it a lot. Build my own Data Engineering Academy at LearnDataEngineering.com and in 2021 I quit my job to do this full time. Since then I created over 30 trainings from fundamentals to full hands-on projects.

I also have over 400 videos about Data Engineering on my YouTube channel that I created in 2019.

Ask me anything :)

321147


r/dataengineering•

Can anyone tell me why this is such a big thing?
Why is this the ultimate goal?
Is it just the money or the prestige of working at Facebook, Amazon, Apple, Netflix or Google?

I worked at a 350.000+ employees German company for over 10 years. What I found is that in large companies you are actually bound by a lot of processes and structures. You are a cog in the big machine.
For instance I heard from engineers at Facebook that the tasks are very narrow and many are just glorified ETL developers.

Wouldn't it be a lot better to aim for a job with great opportunities, where you and your small team can actually move something? A job where you are responsible end to end and learn and u

159130

r/dataengineering•

Posted this yesterday on my LinkedIn. I'm not sure if that's a good or bad thing.
One thing i know: Live coding tests are dumb. What really makes sense is to give applicants "homework" that they have to solve and that will be judged by the hiring person/team.

Most of the time we google stuff anyways, right!? :D

So might be a good idea next time you apply to at least once go over to hackerrank and look what the fuzz might be about. Hope that helps

https://preview.redd.it/9ngxk1brh1x81.png?width=528&format=png&auto=webp&s=7857d960fbb0cd6a515d6ed33163ed744cc37467

6688

You've reached the end of this feed.