Are you a business leader needing to understand what it takes to build a data automation system? This newsletter is perfect for business leaders wanting to learn the high-level overview of the modern data systems. Upon signup, you'll also unlock my mini-course "Data Systems 101 for Business Leaders." Under half an hour, you will gain the basic understandings of the data infrastructure components and implementation options to make your vision come true.
Share
New video: What's happening to the software job market: The Simplest Explanation
Published over 1 year ago • 2 min read
This week's video is the simplest explanation of what's happening in the software engineering job market that looks like this:
The leftmost is the beginning of 2020, and the gray indicates recession. The blue line is the software development job posting on Indeed in the US (Jan 2020=100), and the red line is the federal fund's effective rate. Take this graph a look again after watching my video:
For those who don't like watching a 4-minute video, here is the transcript. (I hope you watch the video for visuals, and please "Like" it on YouTube!)
Many people think AI will replace software engineers, but I think the number of software engineering jobs will increase as AI use cases are developed. Hear me out.
We are in the multi-year correction period of software engineering jobs in the USA.
There was tremendous overheating in the software job market between 2017 and 2022. Waves of factors created the momentum towards overinvestment that staged the dramatic slowdown from 2023, and it happened with or without AI.
First, there were economic successes in tech, symbolized by mega IPOs. Laggard (and big) cash started to flow into tech, especially into the US from all over the world. The zero—to super-low interest rate policies in developed countries reinforced this money behavior.
Soon after the initial shock of the pandemic, people realized that this was the opportunity for a drastic digital transformation. The government further provided liquidity to aid the mainstream economy, only to see the cheap money funneled into digital spending. FAANG went full-throttle in hiring, and the rest followed.
The great war for talent started. Many saw the future in software engineering jobs. Many boot camp programs started. Some even didn’t take tuition until the students landed the job, thinking it was almost guaranteed to get an offer from a company, if not multiple.
This created a dramatic inflow of junior software engineer candidates into the market, but the demand was still strong, and the market swallowed everything until…
The life of staying home finally came to an end finally and so did the digital spend. Meanwhile, the inflation fueled by the war in Ukraine caused the FED to rapidly raise the interest rates to defend the price stability. The money isn’t cheap anymore. If people weren’t getting 5, 10% increases in salary, they were behind the curve. The same is true for businesses with debt and funds. They needed to earn.
The time to dream big and build new products without worrying about cash flow was over. It felt like a game of musical chairs to many who weren’t affluent of the macro trend.
Amid massive layoffs, another shock was created by OpenAI. ChatGPT came in like a savior for the money, looking for a place to go. The AI-related stocks skyrocketed. All the startups needed to put AI like a cherry on top to raise funds. The news headlines danced and caused fear among software engineers for losing their jobs for AI, except for those engineers who tried AI for software development.
The leadership thinks the AI move is the way to raise more money or the stock price. They think AI is the final weapon against wage inflation. Zuckerberg declared the year of great efficiency, and the whole industry followed suit.
…This made a great headline and certainly did not help the software job growth, but it wasn’t the root cause for the historical job decrease for software engineers. It had been staged already.
We are in the multi-year correction stage and may not have seen the bottom yet. However, I’m optimistic about the long run.
AI is truly opening the door for further innovation. But we just learned the reality: it is far from being an AGI, or artificial general intelligence, and it requires humans to steer AI to get the right output. Completing AI-powered use cases takes more work in the last mile.
With the increased level of imagination and opportunities, the demand for software engineering will increase like we have never witnessed in the past—that’s my prediction.
Thank you for reading!
Profitable Data Systems Newsletter
by Daigo Tanaka, PhD
Are you a business leader needing to understand what it takes to build a data automation system? This newsletter is perfect for business leaders wanting to learn the high-level overview of the modern data systems. Upon signup, you'll also unlock my mini-course "Data Systems 101 for Business Leaders." Under half an hour, you will gain the basic understandings of the data infrastructure components and implementation options to make your vision come true.
Hello Data-driven Business Leaders! Today I want to talk about how to get started with building your data team from scratch. 📹️ Watch it now on YouTube For those who don't like watching a video, here is the transcript. (I hope you watch the video for visuals, and please "Like" it on YouTube!) There’s a common misconception that you need to start by hiring a data scientist. While data scientists have been hailed as the ‘sexiest job of the 21st century,’ they aren’t always the best first hire,...
Enhance your data strategy with our video lecture on 'Data Systems for Business Leaders.' Explore the star schema concept - a vital database schema for efficient data querying and improved analytics. Unlock the power of the star schema to elevate your business operations. 📹️ Watch it now on YouTube Here is the text summary (But I hope you watch the video for visuals and please "Like" on YouTube!) In today’s data-driven world, terms like data lake, data warehouse, and data mart are commonly...
Enhance your data strategy with our video lecture on 'Data Systems for Business Leaders.' Explore the star schema concept - a vital database schema for efficient data querying and improved analytics. Unlock the power of the star schema to elevate your business operations. 📹️ Watch it now on YouTube Here is the text version (But I hope you watch the video for visuals and please "Like" on YouTube!) Understanding and leveraging data systems is crucial for organizational success in today's...