someproteinguy wrote:
Where there's a will there a way I guess. Seems like the kind of thing that whether or not it's legal, they'll probably find a way to make it illegal. A program that could detect and avoid likely law enforcement in that way seems like the kind of thing that wouldn't be liked much. If nothing else you probably can't discriminate against people just because they might be law enforcement. Blue is the new black?
Well, with only a bit of
, the concern is something many privacy advocates have been talking about for years now. The very nature of data collection leads to forms of discrimination. Even when a company is choosing what advertisements to send to which groups (or even individuals), that's still a form of discrimination. Now we might view choices in terms of who gets the ice cream ads and who gets the health food ads to be pretty benign, the same tools can be used for other, less acceptable forms. At the end of the day, the data collected is a form of profiling that goes well beyond what any law enforcement agency has ever even imagined, but can have significant socio-economic impact.
Even ignoring the more overt aspects (like just not responding to sets of people who've been profiled as "bad customers"), the basic advertising bit can be a concern. Advertising affects behaviors (otherwise no one would do it). When advertising is tailored to groups of people based on micro-profiling, you can easily steer people to different lifestyle behaviors based on those profiled characteristics. So white middle class folks are being exposed to an entirely different "world" than working class blacks, for example. Everything from what pop ups appear in our browsers, what email ads appear in our inbox, what random stuff shows up in our facebook feeds, what searches pop up first in our browsers, etc. Even setting aside any deliberate malicious efforts, it still can serve to divide people into groups based on profiled assumed responses, and thus actually enhance the very assumed differences. When groupA is always presented with one set of information, and groupB presented with a different one, based on the assumption that groupA and groupB innately prefer different things, it will tend to actually create and re-enforce that starting assumption. You can literally make stereotypes true with this sort of thing.
The really scary potential to this is when folks realize that instead of just waiting to see what people like or want and then tailoring to those things, they can start shaping peoples needs and wants proactively, and then tailoring each level of information interaction based on responses to the previous one all designed to nudge their audience to sets of results they want. Which can be anything from purchasing choices, lifestyle choices, social ideology, and politics, to entertainment, what sports they like to watch, how they receive news, how they communicate with others around them, etc, etc, etc.
A Brave New World indeed.