logoalt Hacker News

crystal_revengeyesterday at 7:10 PM1 replyview on HN

I'm always a bit surprised by the degree that non-tech people don't understand how much they're being openly and transparently manipulated in various ways. Most of my work has been statistical/quantitative in nature from complex A/B testing setups to dynamic pricing algorithms. Yet so many of the most benign parts of my work in the past unnerve some people.

Measuring human behavior and exploiting it for some hope at profit has been an obvious part of my job description for many years. Yet I've had friends and acquaintances that are shocked when they accidentally realize they're part of an A/B test "Wait, Amazon doesn't show the same thing to everyone!?" I've seen reddit conversations where people are horrified at the idea of custom pricing models (something so mundane it could easily be an interview question). I had a friend once claim a basic statement about what I did at work was a "conspiracy theory" because clearly companies don't really have that much control.

To your point, at work the fact that we're manipulating people algorithmically isn't remotely a secret. Nobody in the room at any of my past jobs has felt a modicum of shame about optimization. The worst part is I have drawn a line multiple times at past jobs (typically to my own detriment), so there are things that even someone as comfortable with this as I am finds go to far. Ironically, I've found it's hard to get non-technical people to care about these because you have to understand the larger context to see just how dangerous they are.

I have ultimately decided to avoid working in the D2C space because inevitably you realize you aren't providing any real value to your user (despite internal sloganeering to the contrary) and very often causing real harm. In the B2B space you're working with customers who you have a real business relationship with, so crass manipulation to move the needle for one month isn't worth the long term harm.


Replies

upboundspiralyesterday at 8:19 PM

I'm always a bit surprised that people that work in tech can be so passive in regards to their civic duty. Instead of going to lawmakers and legislators and trying to stop their employers from destroying society they just quietly watch from the sidelines.

And if laqmakers are silent, then publicising, collecting, and sharing this knowledge to all ends of the earth through mainstream and independent journalism, paying a few hundred dollars out of their Silicon Valley salaries to put up billboards shining a light on the misdeeds of tech companies towards their own customers and society.

Per your examples, when the average person is made aware of the injustice, stalking, and tracking of them, they are not in any way happy with it, and want things to change.

show 1 reply