Informal survey of sub members: Over the past few years, have you actually started to notice it?
I read the Age of Spiritual Machines back in 99 and was aware of the concept of the Singularity back then but only recently have I really started to viscerally feel the pace of technological acceleration speed up. It feels like we're pivoting every few weeks which only used to feel like every few months. I'm curious to know if anyone else feels the same way and why?
Posted Oct 10, 2014, 8:17 PM UTC
Could just be the fact that we have more immediate access to a wider swath of news (including remarkably low quality news of course). Our dailys lives are now defined by an constant deluge of articles, columns, blog posts, reddit posts, facebook posts, tweets, headlines, youtube videos, tv segments, podcasts, etc. etc. etc.
When you have tons more "news" (of a sort) firehosing at you around the clock you feel like more is going on, but really, you're just more aware of what's going on. There isn't necessarily more actually going on.
This theory has also be proposed to explain why people think we live in such violent times. We read and learn and watch and hear about wars of all sizes between groups of all sizes in every far-flung corner of the world, so we think the degree of conflict is dramatically worse than ever before...but from my understanding, this sense of increasing war and violence is actually inaccurate. Apparently, we live in a very peaceful time compared to most of history. It's just that throughout most of history people had no idea what else was going on because there was so little media to absorb.
On your last point, of course I think we all agree. Stephen Pinker has written and spoken about this decrease in violence extensively.
More than anything, the question was a way of probing other members of the sub to see if they're feeling something similar that I've felt myself. Even discounting for the effect of encountering tons of pop-sci (frankly) bullshit articles, if I look back it still feels like the acceleration has increased.
Personally and professionally, my interest is in machine learning and even just there the advances have felt very different. From the early 00's to about 2008 it felt like there weren't that many changes and then it started to feel like it ramped up and now it just feels like BOOM, BOOM, BOOM - insight after insight, advance after advance.
For example, in 2012 Andrew Ng et al used 16,000 cores, 3 full days of computing time and $1 M to train the Google Brain recognize faces and cats. The system could learn 1 billion parameters then just one year later, Ng developed a cheaper, faster GPU solution that could analyze 11 billion parameters for only $20,000 on just 3 machines instead of requiring a large collection of servers in a warehouse. Then just a few weeks ago Baidu announced that they had built a system with a 100 billion neuron system (the number of neurons in the human brain) and that it was 100 times more powerful than the 2012 system built by the Ng team, and 10 times better than the 2013 system.
This is kind of what I mean by really "feeling the pace of acceleration." That's not a doubling of performance every 18-24 months - that's a 10x improvement every YEAR.