Categories
New

Things 128: No spoilers, Beethoven played correctly, automation vs humans

Puzzle – Do Spoilers Matter?
Research looking into the enjoyment of short stories found that reading a ‘spoiler’ beforehand tended to increase enjoyment. That seems quite possible, but the strangest part is that it holds even for mystery or ironic-twist stories. They even have a chart with error bars, which looks pretty compelling (click for big):

So, you’ll generally enjoy all stories you read (or presumably consume in any medium) more if you read about the ending first.

The question, then: how can you justify not doing this?

Video – Omlette
Here’s a really lovely short (2’30”) animation about a dog and an omlette. If you’re having a hard day, I particularly recommend it.

Audio – Beethoven wants you to play faster
When Beethoven eventually got his hands on a metronome, he marked up symphonies with tempos that nobody can quite believe he really meant, and which are pretty much entirely disregarded. This excellent Radiolab podcast investigates. (The forced conversational ‘style’ gets a little irritating, but the demonstration at the end is fantastic).

Links – Race Against The Machine
Our old friend the Invisible Hand guides us to make work more efficient with technology: robots replace humans on production lines, computer work becomes automated, cars and vacuum cleaners operate themselves, and productivity increases. Brilliant.

From the Luddites on, people have been fighting this change to defend their old jobs, but with hindsight we can say they were mistaken, as prosperity has increased, every time, and will continue to do so.

Or will it?!

Despite the apparent historic benefits, it’s still hard to imagine this trend continuing indefinitely and remaining benevolent.

Now, one can imagine some sort of desirable end point, in which (say) solar power becomes incredibly cheap:

… and robots / algorithms are able to do everything humans don’t want to do, and everything is wonderful and everyone is happy.

Of course, quite how you would run such a society isn’t entirely clear, and as Voltaire points out, work isn’t only about earning money:

Work spares us from three evils: boredom, vice, and need

But of more concern right now is how we organise society as we transition towards that end-point. In particular, it seems reasonable to suggest that automation of jobs will tend to increase inequality, as (in a simplistic model), the few that own the robots / server farms reap all the rewards of that automated labour while everyone else loses their jobs.

In case you need reminding, inequality is bad for almost everyone. By the way, a concise point on this topic made by Nick Hanauer in 2011:

If the average American family still got the same share of income they earned in 1980, they would have an astounding $13,000 more in their pockets a year. It’s worth pausing to consider what our economy would be like today if middle-class consumers had that additional income to spend.

Here’s a fun sequence of slides putting the current economic situation (in the US) in 50 years of context (brought together by Business Insider):

Corporate profits as a % of GDP at all time high:

% of Americans with jobs is significantly down:

(Something interesting is happening here, because the more common measure of “unemployment rate” doesn’t look as bad)

Wages as a % of GDP at an all-time low:

(Side-note: these were extracted from a longer chart-based argument to do with wages and debt, which is quite interesting but somewhat disingenuously suggests that just “looking at the data” is some non-political process that can reveal answers, and doesn’t consider the fact that over the same time period the % of retired persons in the US increased from 8% to 13% and could reach 20% in the next 30 years. Still worth a look, though.)

Now, there are many other drivers of inequality (including the feedback loop of lobbying, which The Onion satirises perfectly), and while automation may not have been the biggest contributor so far, it’s worrying that we’re not in a good position just as automation is starting to look like a credible threat to prosperity.

There’s a book on this which characterises the problem in its title: “Race Against the Machine“. I haven’t read it, but apparently the authors make an interesting case and then fail to offer any realistic solutions. The absence of solutions and the seemingly inevitable progress along this line is why I consider this one of the major problems we need to solve (after climate change).

Finally, a really important sci-fi story on this topic: Manna by Marshall Brain, which demonstrates a method by which automation can creep into jobs without replacing them entirely, but the consequences are just as dire. Chapter 1 gives you the gist, but it’s worth continuing to see how he plays out the trend. (At the end he appears to suggest a solution, and unfortunately it appears to be much less realistic than the problem).

-Transmission finally ends

Categories
New

Things 108: Mix Shifts, Skrekkogle, 109 Children vs Real Madrid

Previous Puzzle: Guns & Banjos
Previously in Things I asked how a banjo and gun website could see conversion in its individual sections improving, but overall conversion decline. Xuan pointed out that visits to some part of the site not counted in either section could see an increase in non-converting visits and so drive the effect, but this is a loophole – even without such a section, the problem can still arise.

The answer here lies in the part of the data not revealed in the setting: the underlying traffic trends. In particular, if you have one particular section (or segment) that converts at a low rate, and the mix of your traffic shifts towards that group, then that will tend to pull down the overall average conversion, even if conversion within the groups is going up.

To take a simple example, consider the following figures for this theoretical guns and banjos site, with figures in the form [before mix shift | after mix shift]:

Banjo section visits [10,000 | 20,000] – lots more traffic
Banjo section sales [100 | 220]
Banjo section conversion [1.0% | 1.1%] – conversion increases!

Gun section visits [1,000 | 1,000] – same traffic as ever
Gun section sales [100 | 110]
Gun section conversion [10% | 11%] – conversion increases!

Overall conversion before:
(100 + 100) / (10,000 + 1,000) = 1.82%
Overall conversion after:
(220 + 110) / (20,000 + 1,000) = 1.57% – overall conversion has decreased!

In practice you will rarely see an effect this strong. On the other hand, you could well see mix shifts drive a significant part of an overall shift in conversion rate. So watch out for that.

Puzzle: Mix Shift Visualisation
This is a really tough one, but I know the Things recipients are up to the task.

Given that mix shifts as described above can be difficult to spot, how might you visualise your website’s data in such a way that any such effects became obvious?

(I have an answer for this, but I feel sure a better answer must exist).

Quote
Everyone seems to be linking to this surprisingly weakly curated collection of Steve Jobs quotes. One part that I did like expressed something I’ve been thinking for a while:

Steve Jobs: I have a very optimistic view of individuals. As individuals, people are inherently good. I have a somewhat more pessimistic view of people in groups.

Or as I’ve tried to distill it: humans don’t scale.

Link
These guys make cool stuff, even if their website is slightly too clever for its own good.

Video
It’s too easy for imagination to be constrained by what we already know exists. That’s why I like things like this video, which help remind us that many more things are possible. It’s not particularly well edited and there are no particular highlights, so feel free to skip through and enjoy the general sensation of weirdness, which is after all what we generally look for on the internet, and indeed in life. Or maybe that’s just me.

Categories
New

Things 107: Transmedia Hardware, Rorschmap, Cyborgs vs Robots

Puzzle
Here’s a cute data analysis puzzle, which I’m amazed I didn’t encounter sooner in my line of work.

You run a website that sells guns and banjos, and one day you notice from your web analytics data that the conversion rate of your site (orders divided by visits) is steadily declining over time.

Realising that you essentially cater to two quite different needs, you look at the performance of your two main site sections: the gun section and the banjo section. There is no significant overlap between the people visiting these sections.

Here’s the problem. The conversion rates in both the gun and banjo sections of the site are going up over the same period that overall conversion is going down. How is this possible?


Video
Some serious puppetry:

http://www.youtube.com/watch?v=HFf3ZWNF6EY

Link
Charlie Gower realised he could get old iPod shuffles cheaply on eBay and dedicate each one to a single artist. Generalising, he asks, “How does the (almost) free hardware affect the delivery of the (almost) free media?

Picture
I’ll let the name of the idea do the talking: Rorschmap.

Puzzle AnswerCyborgs beat Robots
In the last Things I invited you to guess who would win in a chess match in which humans and computers could team up in any combination.

I recently read of an empirical answer here, which makes the excellent point that there are actually three criteria at work in any team: the chess skill of the computer(s), the chess skill of the human(s), and the friction in the way they work together as a team.

Some may be surprised to learn the most basic observation from the event: that a team of human + computer is much stronger than even an extremely powerful chess-playing computer. As Kasparov puts it: “Human strategic guidance combined with the tactical acuity of a computer was overwhelming.” Humans are useful!

More impressively, the winner of the tournament was a team of two amateur players working with three computers. The lack of friction in their system of working together beat the raw power of chess-playing supercomputers and the strategic brilliance of grandmasters.

This has some serious implications, too. Most simply, since mediocre computers and mediocre humans are more common than highly skilled ones, and since systems can be invented once and then used by all, there is in some general sense much more potential to solve hard problems than we might otherwise have expected in the world.

More extremely, anyone worried about a technological singularity in which we invent AI that is smarter than us (leading to runaway self-improvement of the AI and a very dangerous 4 hours for humanity) can rest assured that human-AI combinations will probably be smarter than pure AI.

Short version: cyborgs are smarter than robots.

Categories
New

Things 105: Pervasive Game Event, Monty Hall, American Politics

Upcoming Event, Thursday August 4th
People that like Things are very likely to like this. On Thursday August 4th from 7pm-10pm, Hide & Seek are running a Sandpit gaming event at the Southbank Centre. In practice this means you get to turn up and play lots of interesting games (for adults) for free. Having been to quite a few of these in the past, I highly recommend it as the games are always fascinating and inspiring. I’m particularly excited about this one because Clare and I will be running a game ourselves, one based on the age-old problem of tessellating pieces of cheese to make a perfect sandwich.

More details of the event can be found here, and the official Facebook event is here. Let me know if you think you can make it!

Puzzle – Monty Hall
After talking to some people about last week’s Two Envelopes puzzle, I realised that many Things readers may not be familiar with the Monty Hall Problem, which one should really understand before tackling the Two Envelopes. So I’ll state that here, then go through the answers to both in the following Things.

In the Monty Hall problem, you are in a gameshow presented by the eponymous Monty. You are asked to choose one of three closed doors. Behind one of the doors is a nice car that you apparently want to win. Behind the other two doors are goats. If you choose the door with the car behind it, you win the car. If you choose a door with a goat behind it, I don’t think you win a goat, but you definitely don’t win the car. Basically the goats are there just for comedic effect.

So you choose a door, pretty much at random. At this point Monty (who knows where the car is) opens one of the remaining two doors to reveal a goat. He does this in every episode of the show – whichever door the contestant chooses, Monty will always then open one of the remaining doors to reveal a goat. He then offers you the chance to switch from your first choice to the other unopened door. The question is: should you switch?

Link
Sometimes The Onion packs a headline with so much satire it barely needs the accompanying article. Most recently I was impressed by American People Hire High-Powered Lobbyist To Push Interests In Congress.

Quote
From Jon Stewart’s speech at the “Rally to Restore Santiy”:

The press can hold its magnifying up to our problems bringing them into focus, illuminating issues heretofore unseen or they can use that magnifying glass to light ants on fire and then perhaps host a week of shows on the sudden, unexpected dangerous flaming ant epidemic.

Picture
This National Geographic healthcare data visualisation achieves a rare feat: showing the data in an unconventional way that nonetheless actually tells a story with the data quite well. Charlie Park has some great commentary on why a scatter plot of this data isn’t actually as useful in his general discussion of slopegraphs.

Click for big: