What is education for?

Say you read something like this article. It’s about yet another failing for-profit college that saddles its students with large debt loads, delivers flawed – possibly useless – education, and graduates fewer than half their students, while making the founders super rich. It’s enough to make you wonder what education is for.

For that matter, I live next door to Columbia University, and for the past week, every day, there have been countless graduations with the requisite ceremonies on campus. Some of them are for things like Columbia college, to be sure, but others are much more confusing. There are countless “cash cow” MA programs at Columbia, with at least 3 in finance alone (one based out of the stats department, one from the math department, and one from the business school). And, whereas we “care about diversity” in many of our college programs, in many of these they are utterly dominated by Chinese kids who get specific STEM versions of student visas that allow them to stay in the U.S. for some months after their program ends.

What’s the actual point to all of this? And I say this as a former director of a post-bac journalism program myself.

And look, I definitely think we taught our students something in that program. But I’m still wondering why exactly we send people to school in such numbers, where 50 years ago we simply didn’t.

Here are some theories, each of which I could make the case for if I were in the mood:

  1. It’s a way to get these kids edumacated, for them to accumulate important knowledge. This is probably the least likely option.
  2. It’s a way to socialize our young people and help develop their networks and social skills, so that someday they can call on their friends to deploy insider trading.
  3. It’s a way to rank all people in the world for future employers.
  4. It’s a way to give day jobs to people who do important research.
  5. It’s a way to give day jobs to people who dedicate their time to gaming the US News & World Report college ranking model.
  6. It’s a way for foreign kids to get American educations and then American jobs.
  7. It’s a way for colleges to make money and enlarge their brands and endowments.
  8. It’s a way for companies to avoid training their workers and force them to pay for training before they get offered a job, now that unions have been decimated and nobody stays with a company for more than a few years.

Am I missing something? And is one of these any better an explanation than any other?

Categories: Uncategorized

White House report on big data and civil rights

Last week the White House issued a report entitled Big Risks, Big Opportunities: the Intersection of Big Data and Civil Rights. Specifically, the authors were United States C.T.O. Megan Smith, Chief Data Scientist DJ Patil, and Cecilia Munoz, who is Assistant to the President and Director of the Domestic Policy Council.

It is a remarkable report, and covered a lot in 24 readable pages. I was especially excited to see the following paragraph in the summary of the report:

Using case studies on credit lending, employment, higher education, and criminal justice, the report we are releasing today illustrates how big data techniques can be used to detect bias and prevent discrimination. It also demonstrates the risks involved, particularly how technologies can deliberately or inadvertently perpetuate, exacerbate, or mask discrimination.

The report itself is broken up into an abstract discussion of algorithms, which for example debunks the widely held assumption that algorithms are objective, discusses problems of biased training data, and discusses problems of opacity, unfairness, and disparate impact. It’s similar in its chosen themes, if not in length, to my upcoming book.

The case studies are well-chosen. Each case study is split into three sections: the problem, the opportunity, and the challenge. They do a pretty good job of warning of things that could theoretically go wrong, if they are spare on examples of how such things are already happening (for such examples, please read my book).

Probably the most exciting part of the report, from my perspective, is in the conclusion, which discusses Things That Should Happen:

Promote academic research and industry development of algorithmic auditing and external testing of big data systems to ensure that people are being treated fairly. One way these issues can be tackled is through the emerging field of algorithmic systems accountability, where stakeholders and designers of technology “investigate normatively significant instances of discrimination involving computer algorithms” and use nascent tools and approaches to proactively avoid discrimination through the use of new technologies employing research-based behavior science. These efforts should also include an analysis identifying the constituent elements of transparency and accountability to better inform the ethical and policy considerations of big data technologies. There are other promising avenues for research and development that could address fairness and discrimination in algorithmic systems, such as those that would enable the design of machine learning systems that constrain disparate impact or construction of algorithms that incorporate fairness properties into their design and execution.

Readers, this is what I want to do with my life, after my book tour. So it’s nice to see people calling for it like this.

Categories: Uncategorized

Google to stop showing Payday ads

Great news this week for people who have been preyed upon by sketchy online lenders: Google will be cutting off their access to customers through its “AdWords” advertisements (but not its native search).

Specifically, Google’s new AdWords Policy now requires lending advertisers to show their APR is at most 36% and that they do not require loans to be paid back within 60 days.

Some comments:

  • This goes into effect on my birthday, July 13th. What a thoughtful present!
  • It doesn’t apply to other kinds of loans, even if they’re terrible.
  • I’ve read that it is supposed to apply to “lead aggregators” for payday loans but I don’t see in the new policy how that might work. In other words, if the advertiser isn’t offering a loan at all, but is offering to connect people with “great loans,” how does Google check to see what they underlying offers really look like?
  • Payday lenders are tricky, and they get around rules all the time to continue their business. For example, take a look at this Washington Post article to see a few ways they might try. How is Google going to keep up with them?
  • On the other hand, one of the main ways payday lenders get around state bans on payday lenders is by coming on to people online, and Google is closing off this avenue explicitly, which will really help for people living in New York, for example.
  • What I’m leading up to is that Google is leaping over regulators like the CFPB, which kind of makes Google into a quasi-regulator itself. I’m curious as to how it will play out. How many people will be employed by Google to track this stuff down?
  • Also, how much money are they walking away from? At least something like $35 million, according to this article. It’s a lot of money but less than 1% of their total revenue.

The payday lending industry, which has a well-paid lobbying arm doing sneaky things, is up in arms, as we might expect. Their argument is along the lines of calling it “discriminatory and a form of censorship,” as if there’s some freedom of speech issue here. There isn’t, since Google is a private platform and can control what it puts on its site.

But there is something interesting going on, if we were to pursue that argument a bit further. Imagine Google ads as a kind of corporate town square, where companies get to broadcast their wares to potential customers. Then, given the nature of targeted online advertising, we should really imagine it as a series of back alleys in which the most vulnerable and desperate individuals, chosen just as much for their zip codes as for their search query, are taken aside and promised their problems will all go away if they just sign on the dotted line.

One last comment. I might be making too much of this, but it feels like a turning point. Instead of just getting rid of truly obvious bad actors (illegal drugs, counterfeit goods, explosives), Google has actually gone further and made a judgement call, and a good one. I’m thinking that means they are starting to acknowledge the responsibility they have to the worst-off of the people who inhabit the environment they create. And that’s a good thing. I hope they get rid of for-profit college ads next.

Categories: Uncategorized

Algorithms are as biased as human curators

The recent Facebook trending news kerfuffle has made one thing crystal clear: people trust algorithms too much, more than they trust people. Everyone’s focused on how the curators “routinely suppressed conservative news,” and they’re obviously assuming that an algorithm wouldn’t be like that.

That’s too bad. If I had my way, people would have paid much more attention to the following lines in what I think was the breaking piece by Gizmodo, written by Michael Nunez (emphasis mine):

In interviews with Gizmodo, these former curators described grueling work conditions, humiliating treatment, and a secretive, imperious culture in which they were treated as disposable outsiders. After doing a tour in Facebook’s news trenches, almost all of them came to believe that they were there not to work, but to serve as training modules for Facebook’s algorithm.

Let’s think about what that means. The curators were doing their human thing for a time, and they were fully expecting to be replaced by an algorithm. So any anti-conservative bias that they were introducing at this preliminary training phase would soon be taken over by the machine learning algorithm, to be perpetuated for eternity.

I know most of my readers already know this, but apparently it’s a basic fact that hasn’t reached many educated ears: algorithms are just as biased as human curators. Said another way, we should not be offended when humans are involved in a curation process, because it doesn’t make that process inherently more or less biased. Like it or not, we won’t understand the depth of bias of a process unless we scrutinize it explicitly with that intention in mind, and even then it would be hard to make such a thing well defined.

Categories: Uncategorized

A Call For Riddles

Dear Reader,

You know that riddle about the wolf, the sheep, and the cabbage? You want to bring them across the river in a boat that can only carry one of them at a time, but you can’t leave the sheep and the cabbage alone together because the sheep will eat the cabbage, and you can’t leave the wolf and the sheep alone together because the wolf will eat the sheep.

Anyway, my 7-year-old son loves that riddle, and every night he demands a new riddle as good as that one, and to tell you the truth I don’t know many very good riddles. So today I thought I’d ask you kind readers for your riddles, to help me out with dinner time conversations.

Happy to take links! Maybe there’s a list or a book of great riddles somewhere I don’t know about!

Thanks!

Cathy

p.s. If you google “list of riddles” you come up with something that’s far too sophisticated and involves word play rather than logic. So maybe “riddle” isn’t the right word.

p.p.s. This list is pretty good. I found it by looking for “logic puzzles.”

Categories: Uncategorized

Math isn’t under attack

Not from airlines afraid of terrorists, anyway.

Since about 15 people have sent me some version of this story about an economist on an airplane, I thought I’d comment briefly on my take.

Namely, it’s mostly due to the lousy reporting, but people have gotten this all wrong. The article’s headline should have read:

Crazy Woman Removed From Plane

because, really, that’s what happened. Some paranoid freak decided that an integral sign on the page of notes of a swarthy Italian man next to her posed a terrorist threat. She passed a note to the flight attendant. The airline took her off the plane. Done.

Well, almost. I mean, they also took the economist off the plane and questioned him, but I’m willing to believe that is absolutely required when terrorist suspicions are thrown around like this insane woman did.

Maybe it’s my inner New Yorker coming out here, but I’m just so used to sitting next to perfectly normal looking people on the subway who turn out to be utterly insane, that I’m ready to assume anyone at all is fucking nuts. And I know I’m not going out on a limb here by mentioning that note-passers older than 13 are already suspect; get up and walk over to someone if you’re worried.

So, short version: some woman was nuts, she indicated as much to the flight crew, and they removed her from the flight. Math isn’t under attack.

Categories: Uncategorized

Forced Arbitration and the CFPB

This morning I’m studying up on the topic of forced arbitration clauses for my Slate Money podcast. That’s part of the fine print when you sign a corporate contract as a consumer or as an employee which states that you will not sue the company for bullshit they might pull, like unfair fees, no overtime pay, or even discriminatory practices.

What’s more, 90% of the time that “forced arbitration” clause is accompanied by an agreement that you also won’t be part of a class-action lawsuit, if by any chance you’d want to do something to address systemic injustice perpetrated by the corporation.

It’s a massively stacked deck; the calculation of how much it will cost, in terms of lawyers, versus how much you’d get if you won you case means that very few people choose the arbitration option. The arithmetic is particularly cruel since, once class-action suits are out of the way, you’re not even benefitting other people who will come after you and find the same shit being pulled.

And of those consumers or employees who do agree to arbitration, they often lose, partly because the actual arbitration process is much more favorable to corporate lawyers (which the other side has but you don’t) than a typical courtroom.

The process entirely depends on a arbitrator being fair and impartial but, believe it or not, the business in question chooses this person, and often for repeat business, which is to say they have at least indirect influence on the decision if the arbitrator wants more work.

So, here’s the good news. The CFPB has come out with strong rules this week which will render moot such forced arbitration clauses in the case of consumer financial lending products. This is great news, and well-needed, given how many of those contracts were flooded with such unfair fine print:

  • credit card issuers 53%
  • prepaid cards, 92%
  • student loans, 86%
  • payday loan 99%
  • checking accounts 44%

However, it doesn’t address other kinds of consumer products, and employee situations, that will continue to have these fine print clauses:

  • nursing home contracts
  • for-profit college contracts
  • employee contracts (22% of employees now sign such contracts)

To learn more, take a look at this fine report from the Economic Policy Institute.

Categories: Uncategorized

Globalization for the 99%

My Occupy group has a new essay posted on Huffington Post, called Globalization for the 99%. The leading paragraph:

As the hard fight over the Trans Pacific Partnership (“TPP”) proceeds, it is important not to confuse the foulness of the TPP’s proposed rules with the otherwise difficult, but not altogether undesirable, prospect of super-national rules of law. To put it bluntly, we should reject the TPP but we should embrace the idea of international cooperation. When we generically decry “globalization”, we are throwing the baby out with the bathwater. We actually want globalization, just not the kind of pro-corporate globalization that we’ve grown to despise. Instead, let’s rethink what good can come from a new notion of globalization that works for the 99%.

Click here for more.

We’re also hosting a Left Forum discussion about this topic, with participants Tamir Rosenblum and The New School for Social Research economics professor Sanjay Reddy. Here’s the abstract:

Occupy’s AltBank (Alternative Banking Group) has proposed a blueprint for international free trade agreements driven by the interests of the global 99% instead of the global 1%. The blueprint will be presented by its author, Tamir Rosenblum. Economist Sanjay Reddy of The New School, specializing in development and international economics, will respond and the discussion will be moderated by mathematician, big-data critic, author and activist Cathy O’Neil.

More information is here, but it will be Sunday, May 22nd at noon, at John Jay College of Criminal Justice, 860 11th Ave (Between 58th and 59th) in New York.

Categories: Uncategorized

Prime Numbers and the Riemann Hypothesis

I just finished reading a neat, new, short (128 pages) book called Prime Numbers and the Riemann Hypothesis by Barry Mazur and William Stein.

41L2LcK+nuL._SX329_BO1,204,203,200_.jpg

Full disclosure: Barry was my thesis advisor and William is a friend of mine, and also a skater.

maxresdefault (1)

But anyhoo, the book. It’s really great, I learned a lot reading it, even though I’m supposed to know these things already. But I really didn’t, and now I’m glad I do.

The book doesn’t require a Ph.D. in math to read, though. It is in fact aimed at a person who may have forgotten what the definition of a prime number is. So, there’s a description of the sieve of Eratosthenes as well as the classic proof that there are infinitely many primes.

And, it’s a great combination of authors. True to form for Barry, there are elegant, “pure thought” explanations of deep truths, as well as ample sprinklings of philosophical ruminations. And true to form for William, there are tons of computations that are carried out and expressed graphically, which really help in illustrating what they’re talking about.

 

20160503_133917

And what do they talk about? After describing basic questions about how often primes show up, the discuss such things as:

  • what it means for a function to be a good approximation of another function
  • Fourier transforms
  • Dirac delta “generalized functions” – a seriously good explanation
  • The Riemann zeta function and its zeroes, obviously

The book is set up in three parts, conveniently set up so that people who don’t know calculus know when to close the book (although they could also take a detour and read The Cartoon Guide to Calculus instead), or for people who aren’t comfortable in functions of complex variables to skim the last two parts.

Do you know what? The more I think about it, the more I realize that this book does exactly what most general audience books dare not do – including mine – which is to say, they use formulas, and graphs, and generally speaking ask the reader to work hard, in the name of enlightenment, beauty, and wonder.

Technical work for the reader such as this is, normally speaking, something of a third rail. Not in this book. In this book the authors run straight for that rail, set up a game of catch, and invite you to join their picnic in the rain, electric shock be damned. They’re having so much fun that you can’t help yourself.

If I have one complaint it’s all the pictures of white male mathematicians. Yes, I get that they did this work, and this work is amazing, and some of them are my friends, but as an educator I want to be aware of the stereotype threat that this sets up for other readers. I’m still planning to recommend it to people (please read it!) but it would have been even better if it focused on the ideas more and the people less. My two cents.

Categories: Uncategorized

Fiscal Waterboarding & Ponzi Austerity

Last week I read Yanis Varoufakis’s book, And The Weak Suffer What They Must? Europe’s Crisis and American’s Economic FutureWe were expecting Yanis to join us on Slate Money, which he did not end up doing, but I wanted to report on the highlights of the book anyway.

1. “A debt may be a debt but an unpayable debt does not get paid unless it is sensibly restructured.” 

Unsurprisingly, Yanis spends a lot of the book talking about debt and debt forgiveness. In particular, he goes into the history of the post-World War II period when Germany’s debt were forgiven, and how critical that was to its growth.

He makes the point that, given that the countries in the Eurozone have no ability to set their currency exchange rates, the deficit countries like Greece, Portugal, Spain, and Italy have very little power to pay back their debts without either debt forgiveness or a “political union,” which is to say something more like the way the U.S. federal government redistributes money from Massachusetts to Mississippi.

Or, as Yanis put it, “Debt was a symptom of Europe’s awful institutional design, not its problem.”

2. “That monetary union is good for Europe’s economy and consistent with European democracy ought to be a theorem. Europe, however, decided to treat it as an axiom”

Yanis spends the bulk of the book talking about the history of modern monetary policy in Continental Europe, staring with the 1971 “Nixon Shock,” when the US kicked the European currencies off their peg to the dollar and kicked the dollar off the gold standard. This is interesting history which I personally had never learned, and after a few sputters and starts it resulted in the creation of the European Union and the Eurozone.

An interesting point that Yanis makes repeatedly (the book could do with some editing) is that the underlying structures of the European Union and the Eurozone are deeply undemocratic. This maybe seems ok when things are going well and economies seem to be humming along, but in moments of crisis, like we’ve had since 2008, the technocrats basically have all the power, and their decisions regularly and efficiently override the will of the people.

Said another way, the Eurozone was an attempt by Europeans – mostly Germans and French – to make money “apolitical” in the name of the unification of Europe. This was never going to work, according to economists, but the romance of the image was irresistible to many countries.

The one European leader who Yanis credits as seeing this basic problem beforehand is Margaret Thatcher, who was unwilling to join in an earlier version of the Eurozone because of the obvious loss of sovereignty and the lack of democratic influence.

3. “the Bundesbank ensured the European Central Bank would be created in its image, that it would be located in Frankfurt and that it would be designed so as to impose periodic, variable austerity upon weaker economies, including France.”

Yanis spends a lot of time talking about the extent to which Germany is actually in charge of everything going on in the Eurozone, and how rigid and self-interested German bankers are. The first 6 times he mentions this it’s convincing, but after 10 references I started wanting to hear what they’d say.

4. “the Troika is the oligarchs’ and the tax evaders’ best friend”

This wasn’t in the book, but Yanis made an effort while he was Greek’s Finance Minister, to datamine Greek tax returns in order to find tax evaders. He claims this effort, which would have allowed Greece to pay back some of its debt to the rest of Europe, was foiled by the Troika itself.

5. Fiscal Waterboarding & Ponzi Austerity

Yanis is a wordsmith, and he comes up, or at least uses, evocative and memorable phrases to explain complicated political situations. Specifically, he talks about the way the Greeks have been repeatedly bailed out at gunpoint as “fiscal waterboarding,” and the way that the imposed austerity is not only not creating the abundance it was supposedly intended to, but is instead sucking up resources and laying waste to communities, as “Ponzi austerity.”

Speaking of bailouts, Yanis convincingly describes most if not all of the bailouts imposed on Greece as a combination of 1) sending money to German and French banks via Greek taxpayers (and for that matter Irish taxpayers) and 2) kicking the can down the road of the inherent flaws of the Eurozone itself.

The question is, what’s going to happen next? The concept of a political union a la the United States is increasingly unlikely, and the Greek economy is in terrible shape, as we might expect after all this crazy and destined-to-fail austerity.

My guess: the debt is eventually going to be defaulted on, and the Eurozone is going to fall apart, or at the very least lose Greece. My time scale is the next 3 years. The thing I’m worried about is how bad it’s going to get, especially if China also goes bust around the same time.

Categories: Uncategorized

Book Tour

I’m going through a couple new phases with my upcoming book (available for pre-order now!):

WeaponsMath r4-6-06 (1)

Sorry, I have no more galley copies in my kitchen. They were gone really fast.

 

Blurbs

This first and current one is “the blurb phase.” That means my publisher has sent out nearly final versions of my book to various fancy people with the hope that they have enough time in their busy lives to read it and write a blurb to go on the back cover.

It’s really an exciting time because we’ve carefully chosen people who probably won’t hate the book. Which is to say, I’ve started to get positive feedback, and not much negative feedback. That’s a nice feeling!

So pretty much I’d like to hold on to this moment for as long as possible, because when the book is reviewed more widely, the critics – at least some of them – will hate the book. That will be tough, but of course I wrote it to be provocative. So I hope my skin is thick enough for that.

Tour

The other thing that’s happening right now, book-wise, is that I’m scheduling a tour for when the book comes out in September. To be precise, the book comes out September 6th, then the tour starts, hopefully after a party, hopefully where my band plays.

So far I think I’m sticking mostly to the East Coast, but I think I have something in San Francisco as well, and perhaps a stop in the midwest in October.

So, readers, what do you think? Are there awesome places I should be sure to visit? People and communities that love books? I have no idea how this all works but I’m guessing I can add stuff if it works with the schedule.

Categories: Uncategorized

Talking to Yanis Varoufakis on Slate Money this week

Dearest Readers,

Yanis Varoufakis, economist and former Finance Minister of Greece, is currently on a book tour promoting his new book, And the Weak Suffer What They Must? Europe’s crisis, America’s economic future. I’m busy reading it right now.

Why am I telling you this? Because the super exciting news is that he’ll be a guest this week on Slate Money, which means I get to ask him questions.

So, we’ll likely talk about his book, but also timely issues like the situation in Puerto Rico, Brexit, and of course the Greek economy.

Important Confession: I have a celebrity crush on Yanis. And given that, I’m wondering if anyone a bit more level-headed would like to come up with smart questions I should ask him.

Love,

Cathy

p.s. I think Yanis will be in a recording studio in Chicago, so it’s not like I’m going to swoon in person.

p.p.s.

Greece_Yanis-Varou_3393679b

Here’s Yanis killing it with a crazy shirt in the Greek parliament.

Categories: Uncategorized

Academic Payday Lending Lobbyists

We like to think of academic researchers as fair, objective, and politically neutral. Even though we’ve all seen Inside Job and know not to trust economists, the rest of academia seems relatively safe. Right?

Well, Freakonomics has done some really great research and found evidence that researchers took money from a Payday Lending lobbyist group called Consumer Credit Research Foundation, or CCRF, in return for editing rights of their journal articles (hat tip Ernie Davis).

Here’s a list of academics, only 40% of whom are economists, that took money from CCFR or otherwise had contact with CCFR:

  1. Jonathan Zinman, an economist at Dartmouth,
  2. Jennifer Lewis Priestley, professor of data science and statistics at Kennesaw State University in Georgia,
  3. Marc Fusaro, economist at Arkansas Tech University,
  4. Todd Zywicki, law professor at George Mason School of Law (now renamed Antonin Scalia Law School), and
  5. Victor Stango, professor of management at University of California, Davis.

Not all the above are necessarily guilty of truly terrible stuff; FOIA requests are still pending on some of them.

But some FOIA requests have come through. In particular, email chains that show Fusaro let a lawyer from CCRF write whole paragraphs of pro-payday lending propaganda that made it verbatim into his paper, decrying the phrase “cycle of debt” as meaningless. This is in spite of Fusaro’s claim in this same paper that CCRF had held no editorial control. And it looks like CCRF funneled about $24,000 to Fusaro for his trouble, maybe more.

Also, Fusaro had a co-author on the paper who managed to talk to the Consumer Affairs Committee in Pennsylvania’s House of Representatives about the “academic research” she had done with an economics professor, which showed great things about payday lending. And since most Payday Lending regulation happens at the state level – although the Consumer Financial Protection Bureau is considering rules to create national standards – the statehouse is the end-goal for such lobbyists.

Professor Priestley also got funding for a pro-payday lending paper, and in spite of the fact that various FOIA requests are being legally blocked, one of her footnotes is exactly the same wording as we saw above:

Screen Shot 2016-04-21 at 6.45.39 AM.png

There’s more, look at the article.

I’m so glad Freakonomics is doing this kind of investigative reporting. The CFPB has enough work on its hands without so-called impartial research being compromised left and right.

Categories: Uncategorized

Tom Slee’s What’s Yours is Mine

I’ve been a Tom Slee fan for a few years, ever since I read his delightful and illuminating book Nobody Makes You Shop at Walmart, which explains game theory and other economic tools in plain English; in particular, why Walmart is nobody’s first choice but still succeeds in taking over towns, and why a plethora of “choices” can leave you with no good options at all.

Well, Slee has done it again, this time with a well-timed and comprehensive critique of the so-called “Sharing Economy” called What’s Yours Is Mine. He exposes the hyper-capitalism behind the feel-good marketing of Uber, AirBnB, Instagram, TaskRabbit, and other companies.

26220875.jpg

 

Slee is a data nerd, and as such he does quite a bit of number crunching, specifically on AirBnB. For example, he was the guy who, with Murray Cox, figured out AirBnB had purged 1,000 homes from their site right before a “data release.”

Cooking the books looks bad, but it’s not the norm. Slee works out various statistics for AirBnB and compares them to its marketing pitches; most aren’t fraudulent, but they’re consistently misleading. In other words, they shared only those stats that would make themselves look more “sharing-y”, when in fact they make the bulk of their money on fake hotel-like rentals, skirting regulations.

Similarly, Slee makes a strong case, which is not new to those of us who follow this stuff, that a large part of Uber’s value is represented by skirting responsibility for safety, for avoiding insurance issues, for avoiding having capacity for wheelchairs, and the like.

Slee goes into critical quality of life questions for Uber drivers and other “sharing economy” workers and puts the boasts of the companies to the test, which they often fail. So no, Uber drivers don’t typically make $90,000 per year in New York.

There are two parts of the book which are new for us critics of the sharing economy. First, the valuable section on reputation systems. What does it mean when all reviews are 4 or 5 stars? How could a 1-star review ever compensate for something really going bad? To what extent is the rating system a form of big-brother surveillance on drivers, and how can Uber claim it doesn’t control its drivers as employees when it fires those with “bad” ratings?

And most saliently, what kind of trust does the reputation system engender when both driver and rider knows how much power there is in the ratings? As Slee says at the end of this chapter:

We trust strangers on Sharing Economy platforms for the same reason we trust hotel employees and restaurant waiters: because they are in precarious jobs where customer complaints can lead to disciplinary action. The reputation system is a way to enforce “emotional labor”; service providers are compelled to manage their feelings and present the face that the platform demands, to become that “friend with a car” or that “neighbor helping neighbors.”

Slee goes into a “Short History of Openness” that I hope every programmer reads, about the ideals that so often give way to power and control of large companies, leaving a bunch of “hollowed out middle” in their wake – think Pirate Bay.

This segues him to a discussion of the commons, and in particular the digital technological management of the commons. Sharing economy companies can be seen as providers of such, replacing old-fashioned, informal management systems, while creating billion dollar companies along the way.

Which commons is he referring to? For AirBnB, he might be talking about the cultural commons of a Barcelona’s nightlife, when it’s grappling with an inundation of AirBnB tourists. For Uber, he might be talking about the streets themselves, or various taxi cab regulation systems that, for all their clumsiness, protect both riders and drivers in various ways.

In any case, as Slee describes in thoughtful detail, these companies are imposing news kinds of commerce on the commons. This is known in Silicon Valley as “disruption,” and it’s not always an improvement. Slee goes lists ways in which the commons are eroded by commerce in its various forms (I’d excerpt this entire section if I could).

Slee wrote this book because of a pattern of betrayal he has found represented by the sharing economy companies. In his words, “what started as an appeal to community, person-to-person connections, sustainability, and sharing has become the playground of billionaires, Wall Street, and the venture capitalists extending their free-market values even further into our personal lives.”

He’s made his case really well. The only question is, how long will it take for this message to be heard?

Categories: Uncategorized

Can we use data analysis to make policing less racist?

A couple of weeks ago there was a kerfuffle at Columbia, written up in the Columbia Spectator by Julie Chien. A machine learning course, taught in the CS department by Professor Satyen Kale, was assigned to “Help design RoboCop!” using Stop and Frisk data.

The title was ill-chosen. Kale meant it to be satirical, but his actual wording of the assignment didn’t make that clear at all, which is of course the danger with satire. Given the culture of CS, people misinterpreted and were outraged by it. This eventually led to an organized group of students called ColorCode to issue a statement in protest of the assignment, and then for Kale to issue an apology, after which ColorCode issued a second statement.

I’m really glad this conversation is finally happening, even if the assignment was a disaster. I’ve been saying for years that the CS department at Columbia, like many CS departments everywhere, has an obligation to teach and think about the ethics of machine learning as well as the mathematical techniques. And although this was an awkward way to get it started, it’s absolutely critical that it gets done. Machine learning algorithms are not objective, because the data going into them are historical artifacts of racist police practices.

In other words, we need to revive this topic, and do it right. If I were teaching data science or machine learning at Columbia, I’d want to spend a week on the Stop, Question and Frisk data, which by the way is located here; I’ve been playing around with it for a few days now and it’s really not too hard to look into.

What do I think we could accomplish? Well, here’s something I read yesterday that might be expanded upon. Namely, a paper by Sharad Goel, Maya Perelman, Ravi Shroff, and David Alan Sklansky entitled Combatting Police Discrimination in the Age of Big Data.

The idea behind this paper, and a related project housed at Stanford, is to use the Stop and Frisk data in order to:

  1. gather statistical evidence that the Stop and Frisk practices were racist, by for example showing that the “hit rate” of finding a weapon, for example, was much lower for blacks than it was for whites, even in “high crime” neighborhoods, and
  2. develop simple algorithms that the police themselves could use to determine whether their individual biases were overstating the suspiciousness of a given person in a given situation. In other words, it’s an algorithm that is meant to help officers become less racist.

One of the best things about this article is the historical context it gives about the extent to which “reasonable suspicion” is a statistical construction. Judges have been inconsistent with this idea, but there might be an emerging understanding of whether, and in what contexts, it’s considered OK to stop and frisk someone given that the chance you’ll find a weapon is 1% or less.

Personally, I’m not sure it makes sense to equip police with an algorithm to be used in real time. There are obvious issues around gaming such a model, or otherwise learning to evade undesired outcomes. Another way of implementing it, that I think might be more promising, would be at the precinct level. Imagine looking into certain types of stops and frisks and noting the hit rate is too low to warrant the imposition, which would (ideally) change the rules of stop and frisk themselves.

In other words, although I am excited about the idea of using data to track and help prevent racist practices, I don’t think we know exactly what that would look like in practice. But it’s something we desperately need to start thinking about. Let’s have the conversation!

Categories: Uncategorized

Chicago Police Department Task Force Report

I got up early this morning to read yesterday’s Police Accountability Task Force report, or at least its Executive Summary, which reports on the Chicago Police Department. It’s really easy to read and chock full of important information and graphics. Here are a few.

Screen Shot 2016-04-14 at 6.26.35 AM

This shows how disproportionately minority and younger Chicago residents are harassed by the police. Note that the total number of stops for young black males is nearly as large as the population of young black males.

Screen Shot 2016-04-14 at 6.20.34 AM

Blacks are disproportionately stopped without cause. Whites are only stopped when the probability of “finding contraband” is much higher.

Screen Shot 2016-04-14 at 6.29.13 AM

There are huge numbers of complaints against officers, probably many fewer than there could be, given the climate.

Screen Shot 2016-04-14 at 6.29.29 AM

At the same time, the police officers usually get away without discipline even when it comes to complaints that are investigated (40% are not even investigated and only 7% are sustained).

Screen Shot 2016-04-14 at 6.29.51 AM

Excerpt from the report.

Finally, I wanted to excerpt from “Other Key Findings” section:

COMMUNITY-POLICE RELATIONS

The community’s lack of trust in CPD is justified. There is substantial evidence that people of color— particuarly African-Americans—have had disproportionately negative experiences with the police over an extended period of time. There is also substantial evidence that these experiences continue today through significant disparate impacts associated with the use of force, foot and traffic stops and bias in the police oversight system itself.

CPD is not doing enough to combat racial bias. Policies need further clarification, as it is not clear whether and when officers may use race as a factor when initiating stops. While CPD collects a fair amount of data, little is reported to the public. CPD still has significant work to do to diversify its ranks, especially at supervisory levels. And more needs to be done to train officers to acknowledge and address their biases and deploy officers who are culturally competent and have a proper understanding of the communities they are assigned to serve.

Historically, CPD has relied on the Community Alternative Policing Strategy (“CAPS”) to fulfill its community-policing function. The CAPS brand is significantly damaged after years of neglect. Ultimately, community policing cannot be relegated to a small, underfunded program; it must be treated as a core philosophy infused throughout CPD.

CPD officers are not adequately equipped to engage with youth. The existing relationship between CPD and youth—particularly youth of color—is antagonistic, to say the least. Children in some areas of the City are not only being raised in high-crime environments, but they are also being mistreated by those who have sworn to protect and serve them.

Finally, CPD is not doing enough to protect human and civil rights. Providing arrestees access to counsel is a particular problem. In 2014, only 3 out of every 1,000 arrestees had an attorney at any point while in police custody. In 2015, that number “doubled” to 6. The City’s youth are particularly vulnerable and often lack awareness of their rights.

LEGAL OVERSIGHT & ACCOUNTABILITY

Chicago’s police accountability system is broken. The system is supposed to hold police officers accountable to the people they serve and protect by identifying potential misconduct, investigating it and, when appropriate, imposing discipline. But at every step of the way, the police oversight system is riddled with legal and practical barriers to accountability.

IPRA is badly broken. Almost since its inception, there have been questions about whether the agency performed its work fairly, competently, with rigor and independence. The answer is no. Cases go uninvestigated, the agency lacks resources and IPRA’s findings raise troubling concerns about whether it is biased in favor of police officers. Up until recently, the agency has been run by former law enforcement, who allowed leadership to reverse findings without creating any record of the changes. IPRA has lost the trust of the community, which it cannot function without.

Imposing discipline on officers guilty of misconduct has also been a challenge. Existing policies and the woefully inadequate oversight regarding how discipline is imposed have allowed far too many officers to receive little or no discipline even after a complaint is sustained. Discipline is not handed down evenly, and there are several layers in the process where discipline is often reduced.

The collective bargaining agreements between the police unions and the City have essentially turned the code of silence into official policy. The CBAs discourage reporting misconduct by requiring affidavits, prohibiting anonymous complaints and requiring that accused officers be given the complainant’s name early in the process. Once a complaint is in the system, the CBAs make it easy for officers to lie if they are so inclined —they can wait 24 hours before providing a statement after a shooting, allowing them to confer with other officers, and they can amend statements after viewing video or audio evidence. In many cases, the CBAs also require the City to ignore or even destroy evidence of misconduct after a certain number of years.

The community has long been shut out of Chicago’s police oversight system. Meaningful engagement with the community—and giving the community power in the oversight system—is critical to ensuring that officers are held accountable for misconduct.

Finally, in the current system, there is no entity to police the police oversight system itself. There is no way to know if existing entities are performing their jobs with rigor and integrity, and no entity is equipped to identify and address systemic changes regarding patterns and practices of misconduct or bias, or to analyze policies and procedures to prevent future problems. Police inspectors general—often called auditors—have emerged nationally in response to a growing belief that traditional oversight agencies would benefit from having a second set of eyes to ensure that they perform as they should.

Categories: Uncategorized

WMD galleys!

I’m super excited to announce that galleys for my book Weapons of Math Destruction: how big data increases inequality and threatens democracy, available for pre-order on Amazon, or from Barnes and Noble, are now out.

Galleys aren’t the real book, they’re preliminary versions made explicitly for people who might want to review the book, who might want to blurb the book, or who will spread the word about how great it is. I have some copies (technically these are proofs, and the galleys are somewhat more edited):

20160412_182034

This pic is blurry because I immediately started drinking upon receiving the packages.

I know, I know, it’s mean of me to show you this when the actual book isn’t available until September 6th, but what can I say, I’m kind of mean. Plus, if you come over I’ll give you one, so I’m not that mean.

To celebrate I intend to go on a bike ride through Central Park, it’s a gorgeous day!

Categories: Uncategorized

I’ll stop calling algorithms racist when you stop anthropomorphizing AI

I was involved in an interesting discussion the other day with other data scientists on the mistake people make when they describe a “racist algorithm”. Their point, which I largely agreed with, is that algorithms are simply mirroring back to us what we’ve fed them as training data, and in that sense they are no more racist than any other mirror. And yes, it’s a complicated mirror, but it’s still just a mirror.

This issue came up specifically because there was a recent Mic.com story about how, if you google image search “professional hairstyles for work,” you’ll get this:

Screen Shot 2016-04-07 at 9.24.56 AM

but if you google image search “unprofessional hairstyles for work” you’ll instead get this:

Screen Shot 2016-04-07 at 9.26.12 AM.png

This is problematic, but it’s also clearly not the intention of the Google engineering team, or the google image search algorithm, to be racist. It is instead a reflection of what we as a community have presented to that algorithm as “training data.” So in that sense we should blame ourselves, not the algorithm. The algorithm isn’t (intentionally) racist, because it’s not intentionally anything.

And although that’s true, it’s also dodging some other truth about how we talk about AI and algorithms in our society (and since we don’t differentiate appropriately between AI and algorithms, I’ll use them interchangeably).

Namely, we anthropomorphize AI all the time. Here’s a screenshot of what I got when I google image searched the phrase “AI”:

Screen Shot 2016-04-06 at 12.26.32 PM.png

Out of the above images, only a couple of them do not have some reference to human brains or bodies.

In other words, we are marketing AI as if it’s human. And since we do that, we are treating it and reacting to it as quasi-humans would. That means when it seems racist, we’re going to say the AI is racist. And I think that, all things considered, it’s fair to do this, even though there’s no intention there.

Speaking of intention and blame, I am of the mind that, even though I do not suspect any Google employee of making their algorithms prone to this kind of problem, I still think they should have an internal team that’s on the look-out for this kind of thing and address it. Just as, as a parent, I am constantly on the look-out for my kids getting the wrong ideas about racism or other prejudices; I correct their mistakes. And I know I’m anthropomorphizing the google algorithms when I talk about them like children, but what can I say, I am a sucker for marketing.

Categories: Uncategorized

There are lots of ways to break up the big banks

I’ve been going to Alt Banking every week for almost 5 years. Here’s what I’ve learned:

There are lots of ways to break up the big banks.

First, there are ways to create incentives for banks to get smaller by themeselves. For example, we could impose more capital requirements on bigger banks than smaller ones, or more regulations, or we could say that banks beyond a specific size couldn’t engage in certain kinds of behavior, or trade certain kinds of derivatives, or we could impose taxes on those trades that are heavier for larger banks. Progressive taxes that max out at 100% profit when the bank is as big as Bank of America.

Next, we could outlaw huge banks. We could do this by simply defining a legal limit to the size of a bank, or its geographic scope, or the amount of risk it carries. We could even say that its connections to the other financial institutions has to be adequately uncomplicated that, in an event of bankruptcy, we could let it fail and it wouldn’t be a biggie. We could give banks 4 years to get compliant.

Or we could go nuts and say that banks are no longer able to “create money” at all, which is to say we could put an end to fractional reserve lending. Or, we could just do that for big banks, where reserve requirements would get larger as banks get larger. We could change accounting laws around banking to make it a lot harder for them to hide risk. We could make it illegal for them to trade derivatives, or impose a new version of Glass-Steagall to make certain things illegal. We could impose all sorts of laws that would blow them out of the water permanently.

Or we could go the other way entirely, and nationalize one of the big banks, or all of them, and let them remain big but treat them like utilities, and make them super duper boring, and pay no bonuses and have the CEO get paid something like $200K.

And I’m not saying what specific we should do – my heart’s probably closest to imposing high capital requirements and limited trading for big banks so they’ll make themselves smaller – but in any case, there are plenty of things we could do that there is no political appetite for. Once again, there’s no shortage of possible plans.

What we do have a shortage of, though, is political will. That’s why we don’t talk about this very much, and we might not have talked about it at all had Sanders not entered the race.

Which is why, when I hear people complaining about Sanders not have a specific enough plan for breaking up the big banks, I think it’s hogwash. What Sanders has, which is sorely needed, in fact is the crucial missing ingredient to any discussion around big banks, is the political will to do something. Once the political will is there, the details can be sorted out by people who think about this stuff all the time.

Categories: Uncategorized

Guest post: Useful Math Tools

This is a guest post by Maxwell Feiner, a New York City high school kid interested in math. Maxwell and I have been having fun math conversations on Friday afternoons for a while now, and I’ve been impressed by the tools he uses, so I asked him to write up a description of them for mathbabe.

When I am doing math in my spare time there are three tools that I use heavily to aid in the process. These three being Desmos.com and Wolframalhpa.com for the aid in solving problems, and Brilliant.org for finding great problems to solve.


 

Brilliant

logo

Brilliant is a fantastic site for users to obtain unique challenging problems, as well as to post solutions to problems posed by others. Think of it as a social site for math. Most of the problems are math, but there are some physics and chemistry problems as well. I like the problems a lot because they require insight beyond what is taught in school classes. They normally cannot be solved using one formula or pre-learned method, but instead require deeper thought and a combination of different concepts in order to be solved. Signing up is required to use the site. It is free. Some sample problems are shown below.

Screen Shot 2016-03-01 at 5.25.46 PM

Screen Shot 2016-02-25 at 8.15.39 PM.png

Screen Shot 2016-02-24 at 2.26.51 PM


 

Desmosdesmos

Desmos is a great, free, and interactive online graphing calculator. It is simple to use, but at the same time very powerful. Besides just graphing equations, the user can put in adjustable values of variables and watch how the graph changes as the variables do. For example, the user could enter the equation y=a*sin(bx+c) and create adjustable values for a,b, and c, then see how changing them affects the graph of the function.

 

Screen Shot 2016-04-02 at 4.04.22 PM

To change the values of the variables, the user can use either sliders (shown), manually input values, or put in a set of numbers or range, such as c=[1,2], where two graphs will be displayed for c=1 and c=2, or  c=[1,2,…10](also shown), where 10 graphs will be displayed, for every integer from 1 to 10. The sliders can also be used to make animations by continually and smoothly incrementing the value of one of the variables. In the graph pictured below I also used the restrictions capability, allowing me to only show a certain part of the graph.

Screen Shot 2016-04-02 at 4.15.23 PM

Another cool feature is movable points, which is demonstrated in two of my own graphs which have links to them below. There are so many features that it would be very hard to explain them all here, so I have provided a link to some of their tutorials on their website and a few examples of some interactive graphs I created. You can create an account and publish your work too.

Here’s a tutorial, and here are some examples of my work:

  1. Tangents to a parabola,
  2. the equation of a square, and
  3. construction of a sine wave

 

WolframAlpha

wolfram

WolframAlpha is a powerful computational knowledge engine that can be used for many purposes, both math and non-math related. One thing it is particularly helpful for is graphing 3-D equations. Just type in an equation,1-D,2-D, or 3-D and it will be graphed. Once on the site, some interesting queries to try include the ones pictured below.

Screen Shot 2016-04-02 at 4.24.10 PM
Screen Shot 2016-04-02 at 4.25.18 PM

Screen Shot 2016-04-02 at 4.36.11 PM Screen Shot 2016-04-02 at 4.41.57 PM
Screen Shot 2016-04-02 at 4.45.24 PM Screen Shot 2016-04-02 at 4.46.47 PM
Other ones to try (just copy and paste into WolframAlpha or click on the links below)

This is just barely scratching the surface of what can be done with the powerful tool.


 

Conclusion

After working with these three tools for a while, I, and many others have benefitted so much from using them. If you are looking for aids in solving problems, or more problems to solve, I highly recommend checking them out. 

Categories: Uncategorized