Archive

Author Archive

Evil finance should contribute to open source

This is a guest post from an friend who wishes to remain anonymous.

I’ve been thinking lately that a great way for “evil finance” to partially atone for its sins is to pay a lot of money to improve open source libraries like numpy/scipy/R. They could appeal to the whole “this helps cancer research” theme, which I honestly believe is true to some extent. For example, if BigData programs ran 10% faster because of various improvements, and you think there’s any value to current medical research, and the cancer researchers use the tools, then that’s great and it’s also great PR.

To some extent I think places like Google get some good publicity here (I personally think of them as contributing to open source, not sure how true it really is), and it seems like Goldman and others could and should do this as well — some sliver of their rent collection goes into making everybody’s analysis run faster and some of that leads to really important research results.

Personally I think it’s true even now; Intel has been working for years on faster chips, partially to help price crazy derivatives but it indirectly makes everybody’s iPhone a little cheaper. Contributing directly to open source seems like a direct way to improve the world and somewhat honestly claim credit, while getting huge benefit.

And it simultaneously has nice capitalist and socialist components, so who wouldn’t be happy?

There are actual problems banks care about solving faster, a lot of which uses pretty general purpose open source libraries, and then there are the maintainers of open source libraries doing this nice altruistic thing but I’m sure could do even better if only they didn’t have a “day job” or whatever.

And if the banks don’t want to give away too much information, they can just make sure to emphasise the general nature of whatever they help fund.

Privacy concerns

The theme of the day yesterday here at the IMA in Minnesota was privacy. There was a talk on privacy and information as well as a discussion later in the afternoon with the participants.

The talk, given by Vitaly Shmatikov, was pretty bad news for anyone who is still hoping to keep private info out of the hands of random internet trolls. Vitaly explained how de-identifying data is a relatively hopeless task, at least if you want to retain useful information in the data, because of the sparseness of most human data.

An example he gave was that the average Netflix user rates 200 films but can be identified on just 4 ratings, at least if you include timestamps. He also pointed out that, even though Netflix doesn’t directly expose its users’ movie preferences, you can infer quite a bit just by looking at how recommendations by Netflix (of the form “people who like House also like Friends”) evolve over time.

And never mind Facebook or other social media, which he explained people can crawl directly and infer the graph structure of; even without any labels for the nodes, which refer to people, one can infer an outrageous amount if you have a separate, labeled graph with overlap on the first.

Conclusion: when people think they’ve de-identified data they haven’t, because other people can collect lots of such data sets, and on top of that some small amount of partial private, identified information about individual users, and piece it together to get creep amounts of stuff.

An example I heard later that day is that someone has figured out how to take pictures of people and give them a large part of their social security number.

The conversation later that day focused more on how companies should protect their client data (through a de-indentifying algorithm), and how for the most part they do absolutely nothing right now. This is perhaps because the problem “isn’t solved” so people don’t see the reason to do something that’s not a perfect solution even though some basic procedures would make it a lot harder. My suspicion is that if they do nothing they are betting they’re more protected from litigation than if they do something that turns out to be too weak. Call me a skeptic but it’s always about litigation.

My contribution to both the talk and the conversation was this: why don’t we stop worrying about data getting out, since it’s kind of a done deal (no data ever disappears and our algorithms are only getting better). Why don’t we assume that all historical information about everyone is out there.

So, besides how to get into my bank account (I haven’t sorted that one out yet, maybe I’ll just have to carry all my money in physical form) I’ll assume everyone knows everything about me, including my DNA.

Then the question becomes, how can we live in a reasonable world given that? How can we, for example, prevent private insurance companies from looking up someone’s DNA or HIV status in order to deny coverage?

This is not an idle concern. As someone pointed out yesterday, 15 years ago nobody would have believed someone who described how much information about the average Facebook user is available now. We have no idea what it will look like in another 15 years.

Categories: data science

To my Libertarian friends

First, I’d like to say thank you to the people who have been writing me very nice comments about the PBS Frontline special. It’s cool that people dug it, and it makes me really glad I did it. Thanks!

Second, I had a blast with Reno the other night doing her “Money Talks” show. You should definitely check her out soon.

Also, I’m on my way to the third day of a modeling conference at the IMA (which is part of the University of Minnesota) called User-Centered Modeling. I’ll be speaking tomorrow and I expect to be blogging quite a bit on the other talks between now and Friday.

And with that, I’d like to use the rest of my GoGo Inflight Internet service to start a conversation about the libertarian mindset.

By the way, in spite of my annoyingly opinionated personality, I actually love having friends I disagree with. It feels much more comfortable to be around people who give me friction and challenge my opinions than to be around people who all think similarly to me.

Why? Because it’s a lot easier to spot other people’s hypocrisies than it is to spot one’s own hypocrisies. So if I’m around people who agree with me, we are all very likely being totally blind to something obviously flawed in our mindset, but nobody’s there to point it out.

With that in mind, I really do want this to be a conversation about why libertarians think the way they do- so please comment if you have something to say (and feel free to tell me not to post your comment). I’ll start with what I see as an hypocrisy of the libertarian perspective.

Namely, the cry I hear over and over from the libertarian in the room (whichever one happens to be there) is that big government and welfare and socialized programs are helping people out who should be able to make shit work on their own, whereas they never asked anyone for any help.

This myth of the “pulled myself up by the bootstrap” kind of drives me nuts. It’s like they completely ignore the system in which they lived and (usually) thrived, and how advantaged they are in that system.

When people go into that riff where they talk about how they never owe anybody any money, and they put themselves through college and don’t see why they should feel bad for the students nowadays who owe a collective $1,000,000,000,000 in student loans because they managed to be successful without extra help, here’s what I ask them: do you think you could have been as successful as you are if you’d been born a female subsistence farmer in Africa?

That’s kind of an easy one (and I go from there) but what it does it contextualize the idea of what it means to not ask for help. Namely, when you have a good infrastructure set up with a good education, available health care, etc, then you don’t need to ask for help, because you can help yourself. But it doesn’t mean you’re doing it all by yourself!

So, if you were born into an honest family with a good work ethic and strong skills and intelligence, then yes it’s possible to work really hard and do well, and I’m always proud of people who work really hard and do well, but it needs to be understood that anyone who is a success in our culture is a success partly because our culture allows for such success – and then there’s the individual contribution component which is much much much smaller.

Did you ever notice in the Ayn Rand novel that there aren’t any kids in them? Or for that matter any disabled people, old people, or sick people? It’s a grownup world where you’re either brilliant and yearn to be free from the shackles of petty people trying to repress your innovation, or you’re one of those petty people.

But actually our world isn’t like that at all. We have a community of humans, and like it or not we each contribute to our culture and do our part in defining success or failure.

I always like to point out that I hate laziness, and I have no patience for laziness. It’s a distraction to talk about how lazy whiny entitled kids expect us to pay for their college and then also expect to be given a cushy job afterwards (because libertarians tend to start talking about such symbols of what is wrong with social programs).

Even if there are examples of such people, there are plenty of other examples of people who genuinely worked hard but needed to take out lots of loans and didn’t understand their terms and now are desperately looking for work but can’t find anything. If the conversation is going well I’ll even talk about how if, as a culture, we are raising a generation of entitled kids (which is an exaggeration), then maybe it’s our fault and not the kids’ fault. Because it is.

Categories: rant

How are you a narcissist?

A few months ago I took a narcissist test on Oprah’s website (see here). I scored exactly average overall, meaning I’m not a narcissist, or rather I’m exactly in the middle for the population for the narcissistic traits, but if I looked at the actual categories I didn’t score average in each category.

In particular, I maxed out in the categories “Authority” and “Exhibitionism” but scored quite low on “Vanity,” “Exploitativeness,” and “Entitlement”.

I think about says it all for why I blog. It’s because I love you all so much and want the world to be a better place, and I know exactly how it should be and I seriously need you guys to listen to me.

Categories: musing

Performing tomorrow night with Reno

May 6, 2012 Comments off

I’ll be in the Lower East Side tomorrow night, at the Dixon Place Lounge, talking finance with Reno, who some of you may know. Here’s more info:

Categories: #OWS, finance

The meritocracy myth

Jack and Larry

Recently a Wall Street Journal article described what I’ll call a “Larry Summers” moment for women in business. Namely, Jack Welch, the former CEO of General Electric, spoke to a bunch of women about how if they work hard enough they’ll be appreciated and get ahead. From the article:

He had this advice for women who want to get ahead: Grab tough assignments to prove yourself, get line experience, and embrace serious performance reviews and the coaching inherent in them.

“Without a rigorous appraisal system, without you knowing where you stand…and how you can improve, none of these ‘help’ programs that were up there are going to be worth much to you,” he said. Mr. Welch said later that the appraisal “is the best way to attack bias” because the facts go into the document, which both parties have to sign.

Just as in the case of Larry Summer’s now-famous 2005 speech about women in science and math, a bunch of women left Welch’s talk in frustration.

There is no such thing as a meritocracy

Having been in academic mathematics and a quant in a hedge fund, I’d guess I’ve experienced what comes closest in many people’s minds as the closest to a meritocratic system. But my experience is that it’s anything but, even in these highly quantitative settings.

Instead, as it probably is everywhere, the job environment is a huge social game where it matters, a lot, what kind of priorities you demonstrate and what kind of other signals you give off or respond to. We don’t expect people to play golf and smoke cigars in academia but caring about teaching, or worse, getting a teaching award, can be the kiss of death.

I’m not saying that your personal efforts don’t matter at all, because they do, and you do need to produce stuff, and at a certain rate, but even “personal efforts” are first of all received in the context of a social order (i.e. the perceived importance of your efforts at the very least is a social invention), and second of all they’re are not really personal – one frames the questions one answers with the help of the community, so it’s important you have a good connection and social acceptance in that community (i.e. access to the experts).

Business in more generality is even less meritocratic- there’s a specific requirement that you must “play well with others,” which is absent from academics (mercifully). This means that instead of being an implicit social game, it’s been made very explicit. This is where people promote their work, take credit for others’ work, learn to say what people want to hear, etc. The performance review is a circle-jerk event for such empty-headed manipulations, which makes it particularly ironic that Welch suggested women take the criticism in an appraisal so seriously.

In my experience, it is unbelievably useful for these social games to have an alpha personality, which just kind of means you assume you’re in charge even when it’s not explicitly a situation where someone’s in charge. People respond to such personalities on a chemical level and there’s really nothing a so-called meritocratic system can do about that.

In other words, I’m not holding my breath for a truly meritocratic system. It’s just not what humans evolved for. Let’s acknowledge that and work on how to make the system responsive to good ideas anyway (whatever the system is).

Successful people want to believe that there is such a thing as meritocracy

This begs the question, why do people like Jack Welch and Larry Summers hold on so tight to the myth of meritocracy? My theory is that it serves a two-fold goal: as advertisement for new people and as a validation of the winners in the system.

People want to feel like they are entering a level playing field then the best thing you can do is advertise it as a meritocracy, because it’s human nature to think that you’re better than average. So everyone wants to enter such a field, assuming they will rise to the top.

At the same time, the `winners’ of the social game want desperately to think they did amazing stuff in order to be so successful. They hold on to the myth of meritocracy as a religious belief, and it is pure dogma by the time they reach upper management. This plays into another part of human nature where we discount luck and the infrastructure that led to our success and take it as a sign of our personal choices. Lots of people in finance in general suffer from this diseased mindset but actually anyone who is high enough up in their respective `meritocratic system’ does too.

That’s my simple explanation for why these guys can go in front of a bunch of women and be so unbelievably tone-deaf. They are true believers, because their entire egos are built on this belief, and it doesn’t matter how much counter-evidence is presented to them, even in the form of humans in the room with them.

One last thought. If I saw people leaving a room in disgust when I was giving a talk, I imagine I’d be slightly aghast- I might even pause and ask them what’s wrong. But I guess that’s because I’m not alpha enough.

Categories: finance, math, rant, women in math

Being a single mom is not a crime

I’m reading a book called “The Righteous Mind: Why Good People Are Divided by Politics and Religion” which explains how people first make moral decisions, then use their brains to argue those decisions.

It also promises to explain how you can actually change people’s minds, so I’m looking forward to that.

My goal of reading this is to understand how good, moral people can really believe some things that seem just so outrageous and illogical to me. I want to know when it makes sense to have a difficult conversation and how to approach it. I’ll tell you how that goes.

But every now and then I lose faith in the idea that those outrageous ideas come from an earnestly moral place. And one example came from my son, who is 12.

If you have a 12-year-old, or if you’ve ever been a 12-year-old, you may remember that they speak somewhat hyperbolically. So when mine told me there’s someone in Wisconsin making it illegal to be a single parent, I thought he was making it up.

But then he found this article for me. I was dumbfounded, and he said I’d have to blog about it since he was right and I was wrong. So here I am.

This just seems so so ass backwards on so so many levels, especially when you think about how it would go down if it became law. Do we get the fathers in trouble too? What if we don’t know who the father is? Do we make it illegal to have unprotected sex in the first place with someone you aren’t married to?

Beyond the crazy idea of where this would stop, I always get upset when I see vulnerable people further abused. If this guy can make a case that kids of single moms are more at risk for various things, why not take that as a cue to give them more support (rather than punishing them)?

Categories: Uncategorized

Great news for NYC dataphiles: Microsoft Research is coming to NYC

This is a guest post by Chris Wiggins.

I was happy to see the news this morning that Microsoft is opening a new research lab in NYC, with 15 of the former members of the Yahoo R+D NYC lab as its founding members.

The Yahoo group is one of the most multidisciplinary research teams I’ve ever seen, with great research collaborations among physicists, machine learning experts, applied mathematicians, and social science, all learning about human behavior by analyzing web-scale datasets.

They have also managed to show how a research lab can make great contribution both to the local and international research communities in their field. For example, Jake Hofman at Yahoo has been teaching a great ‘Data Driven Modeling’ class at Columbia for years; John Langford has been a co-organizer of the New York Academy of Sciences’ one-day Machine Learning Symposium since it was founded (while also organizing international machine learning conferences, running a great machine learning blog, etc…)

Some particularly exciting aspects from the announcement include:

  • Mathematical physicist Jennifer Chayes seems to be implying she’ll be spending at least part of her time here in NYC rather than her current home of MSR-Cambridge
  • Multiple people in the story said they’re interested in ties with startups and universities, which should be good for the intellectual landscape of NYC dataphiles.

Congrats to all and to NYC!

Categories: data science, guest post

Occupy Data!

My friend Suresh and I are thinking of starting a new working group for Occupy Wall Street, a kind of data science quant group.

One of his ideas: creating a value-added model for police in New York, just to demonstrate how dumb whole idea is. How many arrests above expected did each cop perform? [Related: you will be arrested if you bring a sharpie to the Bank of America Shareholder’s meeting in Charlotte!]

It’s going to be tough considering the fact that the crime reports are not publicly available. I guess we’d have to do it using Question, Stop, and Frisk data somehow. Maybe it could actually be useful and could highlight the most dangerous places to walk in the city.

Or I was thinking we could create a value-added model for campaign contributions, something like trying to measure how much influence you actually buy with your money (beyond the expected). It answers the age-old question, which super-PACs give you the best bang for your buck?

Please tell me if you can think of other good modeling ideas! Feel free to include non-ironic modeling ideas.

Categories: #OWS, data science

The student debt crisis

A few weeks ago I wrote about the higher education bubble that I saw at the individual level. This is the idea that, for a given student trying to decide whether or not to take on more loans to go to school, it’s essentially a no-brainer; it’s a cultural given that a college education pays off, statistically speaking, even if in a specific case it doesn’t.

As always, however, the situation at the individual level (a student going into debt) is informed by the overall system. Today I want to write a bit more about how this system got so out of whack.

I’ll actually write about a series of theories of mine, so please tell me if you think I’ve got the facts wrong. I don’t want to claim these are new ideas, but rather a storytelling version of a common understanding of how this all went down. In this case, it’s a story about money and perceived risk, no too dissimilar from the housing crisis.

Before I get into the details of the theory, let me throw in that the Ivy Leagues like Harvard and Princeton have always been super expensive, but that’s part and parcel of their brand. It’s actually intentional, they wouldn’t have it any other way, because part of being elite is being out of control expensive (although it needs to be said that their financial aid to poor kids is exemplary). In other words, I don’t think my theory is going to work on super elite colleges, but that’s fine because most people don’t attend those colleges.

And college always cost some money, although some state schools were really quite reasonable back in the day. It’s just a question of how long after college someone would have to wait or work before their student debts would be gone so they could move on with their lives and think about buying a house (more on that connection below).

Okay, with those disclaimers, let me get started. Namely, it’s all about bankruptcy laws. I know that sounds unbelievable, but it’s really true. From Justin Pope:

Until 1976, all education loans were dischargeable in bankruptcy. That year Congress began requiring borrowers to wait at least five years before they could discharge federal student loans. Since 1998, borrowers have been unable ever to discharge federal student loans, and in 2005 the then-Republican-controlled Congress made private loans almost impossible to discharge.

Why does this matter?

Because it meant that people lending to students wouldn’t need to worry about getting their money back. That sets up a perverse system where young people who are not creditworthy can take on piles of debt.

On the one hand, it’s good for students to be able to finance their education- you wouldn’t want young poor kids to not attend colleges at all for want of enough funding.

On the other hand, it meant that the tuition and fees could essentially rise without pause, since there was nothing to force them back- no supply vs. demand situation.

This is especially true because students aren’t told and do not generally “shop around” for a good deal in college, and moreover colleges are incredibly underhanded about making their tuition and fees clear (I am giving the CFPB about 3 more months to force them to present packages in a standard form before I really start complaining).

Another example: Pell Grants. These are grants given to poor kids to go to college, and they aren’t loans – the government pays them straight to the college. But the colleges have not really made it easier for kids to go to college because of this free money, but rather have raised their tuitions by the amount of the expected Pell Grant. Some colleges are better at getting Pell Grant money than others, and in particular for-profit colleges get 7 out of 10 such grants.

[Speaking of for-profit colleges, how are they allowed to exist? They are the worst of the worst and in particular have outrageous practices in terms of disclosing fees and tuitions, giving commissions to financial aid officers who then urge students to lie on their financial aid forms. Not to mention providing questionable educations.]

I hope it’s not too hard now to understand why student debt has just surpassed $1,000,000,000,000 in this country, ahead of credit cards. On the banker side of the room, these student debts are being bundled up and securitized and sold to investors just like old mortgage-backed securities (which, as you recall, couldn’t fail because the housing market always goes up) who are being told there’s very little risk since students can’t discharge student debt through bankruptcy. There’s a strong analogy with the previous housing bubble and the current education bubble: even ignoring the individual’s goal of becoming an educated citizen and qualified worker, there’s the demand side from the banking system itself which feeds on the fees of securitized products that seem riskless.

But the cost to those individual borrowers is heavy; we have a system whereby young people are being saddled with enormous and unreasonable debt in order to even qualify as a worker, and they are carrying it around like a noose. It is, for example, one thing preventing the housing market from recovering, because the generation of young people who should be buying a house right now is instead still trying to pay off student loans.

What should we do about this?

First of all, let’s focus on the culture of education and how we think about it. Is it a certification process that people should pay for? Or is it a part of what we offer our citizens as their right?

If the latter, it’s time we rethink why state schools should exist, and fund them accordingly, rather than removing more and more funding while expecting them to uphold their state-school mandates. I went to UC Berkeley in the early 1990’s and it was completely awesome, but it’s getting more and more squeezed by the state of California, which is forcing it to choose between becoming a bad school and becoming a private institution. And yes, that means taxpayer money going towards the investment of broad education rather than to banker bailouts.

Second of all, let’s rethink the bankruptcy laws. At the very least for private student debt. For public student debt it also needs to be negotiable in certain circumstances. We need to get the colleges themselves to lower their fees enough that the debt loads are tolerable.

Finally, let’s rethink how much to expect someone to pay down their debt depending on their salary. From Bloomberg:

The second crucial step is to mitigate the burdens of already distressed borrowers. The Obama administration has made progress, for instance by proposing an initiative that would let some students limit their loan repayments to 10 percent of their discretionary incomes next year and would forgive balances after two decades. Private lenders should be given incentives to offer more modifications and flexible payment options.

Yes, this means that some of those securitized student debt loans will default, just like mortgages. And that will mean that already undercapitalized banks will be even more so, because they’ve been taking risky bets yet again, and Sallie Mae will be up Shit’s Creek. But the alternative, of a continuing debt trap for young people, is an even worse alternative.

Categories: #OWS, finance

It’s May Day!

I’m leaving work early today to join the May Day Celebration with Occupy (May Day playlist here).

Bloomberg knows about it, and so does the Wall Street Journal, and if you do a search on the New York Times you can even find something there.

I’ll be participating in the Free University today, talking about “Weapons of Math Destruction” from 2-3 in Madison Square Park, and then meeting my kids there after school for a march down to Union Square with the signs we made in Alt Banking on Sunday. Woohoo!

Oh, and the PBS Frontline special on politics, banks, and Occupy that I’m in (Episodes 3 and 4) airs on PBS tonight at 10pm. Please watch it and tell me what you think, or watch it online here tomorrow, because I made a deal with myself that I’d do it as honestly as I could but never watch it myself. There are outtakes here from my interview that I consider unwatchable as well but people seem to like.

Categories: #OWS

Conclusion (#OWS)

This is the final part of a four-part essay that was proposed by Cathy O’Neil, a facilitator of the Occupy Wall Street Alternative Banking Working Group, and written by Morgan Sandquist, a participant in the Working Group. The first three parts are here, here, and here. Crossposted from Naked Capitalism.

Still sitting in our breakfast nook, with the banking industry squinting grumpily back at us through the glare of the morning sun on the perfectly polished granite table top, we can sit back, rest our hands on the table, and rather than shouting what it expects to hear, playing our part in the script of codependency, we can speak, without pleading or rancor, the truths that are beyond the script.

Rather than repeating once again our expectations and the banking industry’s failure to meet them, rather than pleading with it to live up to its obligations and do what’s fair, we can speak of the mundane practical details of our life and our children’s lives after its eventual demise, of the specific process by which everything around us will be sold to pay the ruinous debts for which its insurance will prove woefully inadequate.

We can make of the inevitability something tangible, rather than a vague, abstract threat. We can catalog the likely disposition of all of the banking industry’s prized possessions and family heirlooms, the eventual owners of everything it values. We won’t engage in a debate over whether the inevitable will occur, nor will we revel in the justice of it, because we’ll all suffer.

The banking industry must take responsibility for the laws it has broken and make appropriate restitution, not because we’re vengeful, but because the connection between choices and consequences so necessary to any successful relationship must be restored. And as long as the banking industry is adamant that it can’t or won’t change, and given the suffering that will follow from that refusal, we have no choice but to regretfully plan for our own and our children’s well-being to the extent we can. Should it accuse us of betrayal, our response is that the first step toward an alternative is one the banking industry must take.

I would have liked to title this section of this essay “Recovery,” but I’m not in the position to do that. I can’t speak to outcomes, only to process. I’m neither imaginative nor prescient enough to suggest what the successful results of our efforts might look like, but I have some idea of how those efforts should be undertaken.

I could use the Twelve Steps of Alcoholics Anonymous (“We admitted we were powerless over debt–that our industry had become unmanageable,” and so on) to describe what might follow from the banking industry taking that first step, but that would be a too literal extension of the metaphor.

The truth is that history offers no examples of the sort of transformation that’s now needed. Though addiction and recovery may offer greater insight into our predicament than yet another political or economic analysis, there’s no reason to believe that the situation will stick to that metaphor as it evolves, even as we proceed with what is essentially an intervention.

Gil Scott-Heron famously said, “the revolution will not be televised.” I take this to mean that any real, fundamental change to the workings of our society, won’t be an entertainment offered by revolutionaries to the rest of us. It won’t be achieved if we sit home waiting for someone on television, or now the Internet, to present us with a number we can call or text, a petition we can sign, or a ballot we can fill out. Our opinions will effect nothing, and our agreement is neither solicited nor required.

I offer this essay not to start another in the endless string of conversations about what is to be done, but to prompt you to do it, whatever it will be, even if what you will do proves that everything I’ve written here it categorically incorrect. I also offer this as an explanation of why I’m doing what I’m doing.

Among other things, I’m working with several participants in the Alternative Banking Working Group on a Web application that will allow people in New York City (and, later, the rest of the country) to find credit unions for which they’re eligible (something that turns out to be far more complicated than you might expect). This will facilitate the return of money from banks, where it functions as an addictive substance, to community ownership, where it functions as a tool in the business of that community.

I do this on your behalf as well as my own, but not in your place. What else will be done and what will come of it will be the result of what you do. The Occupy Wall Street movement is entirely open and will become no more or less than what we make of it. Tomorrow’s May Day events will provide people with the chance to find out for themselves what that movement is, how they can become involved, and what it will become.

With events in more than 115 American cities and many more around the world, you should be able to find an event near you (if you’re in New York City, you can even hear more about the prank played on MF Global by the banks).

Take the day off and meet the people with whom you share this struggle, whether you’ve agreed to it or not. If the movement isn’t what you want it to be, it’s incumbent upon you to transform it as necessary. You can sit home waiting for a movement that checks all your boxes to somehow arise and solicit your participation, but so passive an approach is unlikely to accomplish much.

Let’s all get together on May 1st and see how much we can accomplish in this American Spring.

Categories: #OWS, finance, guest post

NYC Data Hackathon

This is a guest post by Chris Wiggins.

Last night I was a judge for the Data Viz Competition at the NYC Data Hackathon, part of the world’s first global data hackathon. Along with my fellow judges Cathy O’Neil and Jake Porway, we gave an award to the team that best found a nontrivial insight from the data provided for the competition and managed to render that insight visually.

Unlike a hackNY hackathon, where the energy is pretty high and the crowd much younger (hackNY hackathons are for full time students only; this crowd all were out of school — in fact at least one person was a professor), here everyone was really heads down. There was plenty of conversation and smiles but people were working quite hard, even 12 hours into the hackathon.

I noticed two things that were unusual about the participants, both of which I think speak well of the state of `data science’ in NYC:

* I’ve never been in a room with such a health mix of Wall Street quants and startup data scientists. Many of the teams included a mix of people from different sectors working together. The winning team was typical in this way: 1 person from Wall Street; 1 freelancer; and 1 data scientist from an established NYC startup.

* I met multiple people visiting from the Bay Area contemplating moving to NYC. In 2004-2007 many of my students from Columbia moved out to SF under the historical notion that that was `the place’ where they could work at a small company that would demand their technical mastery and give them sufficient autonomy to see their work come to light under their own direction. I was glad to meet people from the Bay Area who were sufficiently impressed with NYC’s data scene to consider moving here. Of course I told them it was exactly the right thing to do
and I looked forward to seeing them again soon once they’d become naturalized citizens of NYC.

Huge thanks to Shivon Zils and Matt Truck for hosting us in such a nice location, to Jeremy Howard for his suggestion a few weeks ago to throw the event, and to Max Shron for encouraging everyone to include a visualization prize as part of this event.

Categories: data science, guest post

An Intervention (#OWS)

This is the third part of a four-part essay that was proposed by Cathy O’Neil, a facilitator of the Occupy Wall Street Alternative Banking Working Group, and written by Morgan Sandquist, a participant in the Working Group. The first part is here and the second part is here. Crossposted from Naked Capitalism.

What are we to do with our banking industry, sitting there at the kitchen table in its underwear, drumming on the table with one hand and scratching its increasingly coarse chin with the other in an impossibly syncopated rhythm, letting fly a dizzying stream of assurances, justifications, and accusations, and generally spoiling for a fight that can only be avoided by complete and enthusiastic agreement with a narrative that can be very difficult to follow, let alone make sense of?

Because this is our kitchen too, we have our legal and moral rights. We would be well within those rights to respond to its nonsense with far more coherent and sweeping condemnations of our own. Throwing the bum out in its underwear without so much as a cup of coffee, taking the children, and keeping our share of whatever might be left could certainly be justified.

Though the sense of release offered by those responses is tempting, they’re not likely to be of any practical use. We can’t win an argument with an irrational person, and our share of an insolvent industry is likely to be very little–certainly not enough to feed the children. We have to recognize the hard truth of our implication in the banking industry and its addiction.

This doesn’t mean that we’re responsible for the addiction and its consequences, or that we can make the choice not to continue that addiction on our own, but it does mean that the problem won’t be constructively resolved without our efforts. To the extent that denial is about obscuring the connection between decisions and results, the most effective means of undermining denial is to clarify that connection, and the process of doing that is intervention.

Whether or not its participants are thinking in these terms, Occupy Wall Street, to the extent that it can coherently be referred to as an entity, is in many respects functioning as an intervention into the banking industry’s increasingly untenable addiction to money and debt.

The movement’s core values of transparency, sustainability, and nonviolence reflect the clarity, patience, and compassion needed for an effective intervention.

This is not to say that all of the efforts directed at banks by the movement have been magnanimous or constructive. We have to remember the terrible suffering that has been inflicted upon so many and offer that clarity, patience, and compassion not just to the addict, but also to ourselves as intervenors and to everyone who has been affected by the banking industry.

On the whole, I have been deeply heartened by how this movement has evolved over the last seven months, and though intervention isn’t the easiest or most promising process, it’s one I recognize and know can work (in stark contrast to political revolution). From the beginning, the Occupiers have shown a fearless, poignant spontaneity that’s available only beyond the addiction-centered dynamic of denial, and the banking industry, its enablers, and others still within that dynamic of denial (which, to be fair, has included most of us at one point or another) have responded as would be expected.

The determination and wisdom granted to those who see more clearly is profoundly threatening to those seeking to maintain denial, though of course they wouldn’t be able to say quite why.

The initial objections from the press that Occupy Wall Street was making no demands could be seen as an enabler’s yearning for symptoms that can be isolated and addressed, without admitting to or addressing the addiction from which they arise. To keep calmly and patiently pointing to that underlying cause is simultaneously incomprehensible and maddening to those trapped within denial, and their responses have run the gamut from smug certainty that nothing could possibly be wrong to whistling past the graveyard to ill-conceived and unjustified violence. And the Occupiers’ patience, diligence, and good nature in the face of that decidedly ill will is as textbook an illustration of the process of intervention as we’re likely to see.

It would be all too easy to remain passive in the face of our increasingly delusional, erratic, and combative banking industry. Surely there must be a more palatable alternative to undermining the continued functioning of the complex and highly evolved process that is the core of our economy.

If we force it to rehabilitate, what will happen during that process? Will our economy collapse? When its rehabilitation is complete, will the banking industry be able to function as well as it once did? Or as the banking industry’s enablers would have it: Any attempts to regulate the banking industry will only harm it, making it less effective to all of our detriment; these banks are too important a part of our economy to be allowed to fail; and bankers must continue to receive bonuses for banks to remain competitive.

It’s true that the banking industry has seized upon the process that’s the basis of our economic survival, and that attempts to address the problems of the banking industry cannot be undertaken lightly. But it’s also true that the banking industry has perverted that process, and that attempts to address that won’t prevent our return to some fantasy of efficiency and plenty, though they might prevent the otherwise inevitable, tragic end of the current trajectory left unchecked.

Whatever happens while the banking industry is rehabilitated is unlikely to be worse than what will happen as it continues to indulge in its addiction unaddressed, and it’s unlikely to function any worse upon the completion of its rehabilitation than it is now. As Charles Eisenstein puts it, “any efforts we make today to ‘raise bottom’ for our collectively addicted civilization–any efforts we make to protect or reclaim social, natural, or spiritual capital–will both hasten and ameliorate the crisis.”

Once an addict has reached the point in his or her descent where an intervention is necessary, there’s no realistic possibility of a return to some pre-addiction Golden Age. The apparent paradox that an addict’s life must be destroyed to save it is, stated in those terms, false. The addict’s life only appears to be as yet undestroyed through the lens of denial, and a future life without substance abuse or consequences is an illusion.

But the more gently stated paradox that intervention will cause the addict suffering in the short term to help him or her in the long term is accurate. There are, however, deeper, more intractable paradoxes, and they are those of the psychology of addiction. The process of intervention is often crucial to an addict’s entering rehab and beginning recovery, yet only the addict can decide to enter rehab.

The addict must understand the damage he or she has done in order to stop using but mustn’t succumb to shame, which would simply cause a retreat to the substance. The addict must admit that he or she is powerless over the substance and that life has become unmanageable, but mustn’t surrender to hopelessness and despair, which would sap the considerable motivation needed in the process of recovery. An intervenor must do something, but there’s nothing that can be done. There is no single act, no grand gesture or magic bullet, that can accomplish anything meaningful or lasting. Intervention is a long, unpredictable process requiring superhuman compassion and patience of everyone involved. Prior training or practice in commitment to a process without regard to the outcome of that process is invaluable.

Yes, we can answer the banking industry’s petulant invective in kind, but that won’t fix the problem; the industry will become more defensive and reckless, and we probably wouldn’t end up feeling any better anyway. Our encyclopedic harangue would be cogent, compelling, and convince our friends in the retelling, but no matter how loud we shout it over the banking industry’s coffee cup into that sullen, bloodshot face, it will simply be brushed aside with the wave of a shaky hand and a hoarse grumble, or, worse, it will hit home, and rattled, the banking industry will glare at us and we’ll know that tonight will bring another nihilistic binge of leverage and derivatives, and maybe this time there will be no tomorrow morning. The industry will tell us that we don’t understand, that the pressure it’s under is unimaginable, that life is grim, and that even though it can’t fix that, it should be thanked for what it has accomplished, and that that’s the best it can do. What more could we want? What more could it do? And we can only sigh and shake our head, because we know the simple, honest answer would just fall on deaf ears, and even if it were understood and accepted, the broken soul sitting across the table is in no shape to do anything constructive.

The confrontations shown on television or in the movies, or that you have perhaps participated in yourself, are just part of the larger process of intervention, but they illustrate the themes that inform that larger process. Those themes can best be summarized as connection: the connection between the addict’s choices and the suffering of the addict and those who are around him or her; the connection between addiction and the addict’s choices; and the unbreakable, always available connection between the addict and the intervenors.

Where denial seeks to divide and conquer, intervention seeks to unify and transcend. Intervention doesn’t respond to denial on denial’s terms, but rather reflects reality as it is. It doesn’t engage in the petty distractions of accusations and recriminations, nor does it seek escape from the addict and his or her problems. Intervention shows the addict his or her choices as they’re made, how those choices are determined by addiction, and the consequences that follow from those choices, but it also shows the redemption that’s always available despite those choices and their consequences.

Where denial is deceptive, impulsive, and selfish, intervention is clear, patient, and compassionate. Intervention finally presents the addict with an unavoidable choice between continued deluded suffering and real, sustainable sanity. The addict may or may not respond positively to that choice, but it must continually be presented on the same terms until the addict surrenders his or her denial.

And to induce that surrender, it’s crucial that the addict be offered an alternative to his or her addiction, whether it’s formal rehab, a twelve-step program, methadone, or a recovery dog. It’s important to recognize that even before the addict became physically or emotionally dependent on the substance, that substance met an otherwise unmet need, and leaving it unmet will lead only to relapse.

Tomorrow: Conclusion

Categories: #OWS, finance, guest post

The Addiction (#OWS)

This is the second part of a four-part essay that was proposed by Cathy O’Neil, a facilitator of the Occupy Wall Street Alternative Banking Working Group, and written by Morgan Sandquist, a participant in the Working Group. The first part is here. Crossposted from Naked Capitalism.

Is it fair to say that because the quality of the denial surrounding the banking industry’s problems is so similar to that of the denial surrounding addiction, that addiction is therefore the root of those problems and our ongoing failure to adequately address them? Perhaps not, but others have come to describe money, debt, and banking as something very much like addiction for entirely different, and far better argued, reasons.

In Debt: The First Five Thousand Years, David Graeber looks deeply into the anthropological record and finds that money and debt, and, by extension, banking, are all essentially the same thing, and they’re not what most of us understand them to be. Money is certainly not simply the objective store of value and medium of exchange that economists would have us believe it is. Because money is created as debt, its use to finance productive activity means that that activity, whatever it is, must then generate interest to be returned to money’s creators in addition to the money lent.

This has given rise to an industry, even a class of people, that derives its livelihood not from any productive activity of its own, but merely from having money. In Sacred Economics, Charles Eisenstein takes this a step further to show that this overhead cost inherent in all monetarily denominated activities means that the value represented by money must always grow. There is no logical end to what must be monetized–natural resources, ideas, time. Nothing can remain unowned and clear of liens, and that will eventually consume any finite realm:

The dynamics of usury-money are addiction dynamics, requiring an ever-greater dose (of the commons) to maintain normality, converting more and more of the basis of well-being into money for a fix. If you have an addict friend, it won’t do any good to give her “help” of the usual kind, such as money, a car to replace the one she crashed, or a job to replace the one she lost. All of those resources will just go down the black hole of addiction. So too it is with our politicians’ efforts to prolong the age of growth.

I don’t hope to make in a couple of paragraphs the full case that those two authors have made over hundreds of pages, so I’ll just assert it to have been compellingly made: namely, that money, debt, and banking have gone from being a tool that we might use to ease social activities to being the purpose of those activities. They have become an addiction, and because they’re an addiction, all of us who are touched by them have developed a rich and pervasive denial of this fact, its history, and its consequences.

In practical terms, what do we gain by perceiving money, debt, and banking as an addiction and the discourse around them as denial? Speaking for myself, it helps me understand the otherwise inexplicable irrationality behind our ongoing financial decline. I can imagine no other explanation for so much of what we’ve seen in the last few years: the failures to properly address the mortgage and subsequent foreclosure crises; the criminal activities of banks, hedge funds, and ratings agencies, and the spiral of consumer indebtedness; the deeply emotional and often militarized response to people sleeping in an otherwise unused square of concrete in a nocturnally unpopulated commercial district; and, most of all, the general populace’s willing acquiescence to all of this.

It appears only that banking must continue as it is, undisturbed, and nothing must disrupt the use and abuse of debt and money. Though an explanation for the full range of symptoms of the banking crisis, or for the full range of symptoms of any addiction, risks being reductive, without some causal dynamic behind these symptoms, there can be no effective response to them. To prevent something from happening, a cause must be identified and addressed.

Understanding money, debt, and banking as addiction also helps me trust myself and seek a constructive approach to the daunting task of resolving this crisis. As anyone who has ever had to face the full force of shared social and familial evasion can attest, the temptation to surrender to that alternate reality despite his or her better judgment, if only for the sake of civil relations, can be overwhelming.

In the case of the banking industry, that evasion often comes in the form of expert opinion that seeks to persuade not through the substance of the discussion, but through a dependence on credentials and ad hominem dismissal. It’s invaluable to be reminded that such a surrender, regardless of expert arguments, will at best only defer the consequences that we fear. Asking ourselves if, at the addict’s eventual funeral, we’ll be comfortable that we did everything we could is a remarkable inducement to focus. It can also be a powerful inducement to anger, so the understanding that it’s really addiction and denial, not friends and family, that we’re fighting can provide a basis for the compassion we would need to constructively approach such an emotionally volatile undertaking.

Finally, this understanding helps me focus on the ultimate goal of any such effort, rather than becoming sidetracked by pointless diversions.

As I mentioned above, one strategy of denial is to hide the connection between the symptoms of addiction and their real cause. It allows the alcoholic to believe that his or her diabetes and other health issues are the result of poor diet and that his or her depression is genetic or the result of poor parenting. It’s not that an alcoholic necessarily consumes a model diet or was well reared, but addressing just those symptoms allows the alcoholic to keep drinking, and other symptoms will follow from that drinking.

Similarly, it’s not that banks don’t need to be better capitalized, but providing them with capital and liquidity alone allows banks to continue pursuing courses of action that are neither financially nor economically viable.

To effectively address addiction is to prevent further addictive use of the substance. Any effort directed at symptoms will, to the extent they’re effective, simply enable continued substance abuse. It’s only by understanding the nature and extent of denial, navigating its maze, and intervening directly in the use of the substance that one can hope to effectively address addiction, and even then, the odds aren’t in the addict’s favor. And only with a thorough understanding of this dynamic and all of its implications can we hope to intervene effectively in the banking crisis that as of now continues unabated.

Tomorrow: An Intervention

Categories: #OWS, finance, guest post

In Denial (#OWS)

This is the first part of a four-part essay that was proposed by Cathy O’Neil, a facilitator of the Occupy Wall Street Alternative Banking Working Group, and written by Morgan Sandquist, a participant in the Working Group. Crossposted from Naked Capitalism.

The largest banks in America–Citibank, Bank of America, Wells Fargo, and others–are probably insolvent. I learned of this from my companions in Occupy Wall Street’s Alternative Banking Working Group. It seems that, based on a host of legal and accounting irregularities, the banks have been able to conceal real and potential losses far larger than their capital reserves. But this has been difficult to confirm.

Isn’t that strange? Wouldn’t the possible insolvency of the core of our banking industry be a matter of nearly universal importance? Shouldn’t we be trying to figure out if this is in fact so, how it came to be, what we’re going to do about it, and how we can prevent its happening again?

Anyone investigating the true health of the banking industry, apparently including regulators, is faced with opacity, complexity, and even outright hostility that stymies all but the most savvy and persistent. Fortunately, people within OWS, including the Occupy the SEC Working Group, are that savvy and persistent. But the reaction of the industry and its partisans to such efforts has included the not-so-subtle suggestion that inquiring into the well-being of the banking industry will somehow cause problems to arise that wouldn’t otherwise exist if we would all just mind our own business.

This seems odd in an ostensibly objective and quantitative context like banking. Shouldn’t the truth be clearly visible in the accounting? Shouldn’t we all–borrowers, investors, depositors, and regulators–want to know exactly what’s going on?

As unexpected as such a visceral and irrational reaction to genuine, well-founded concern is from the supposedly rational realm of finance, that telltale blend of evasion, grandiosity, and superstition will be familiar to anyone who has ever confronted an addict about his or her addiction.

Denial is far more than an addict’s dismissal of the truth of his or her addiction; it’s collectively developed by the addict’s entire social sphere, and it takes many forms.

It might be helpful to imagine addiction and denial as intangible agents acting in a social context. Addiction’s agency is directed solely toward uninterrupted use of the addictive substance, and denial’s agency is directed solely toward ensuring that no one sees, understands, or limits addiction’s agency. Denial denies not just claims and assertions, it also denies access and insight into the reality of addiction. It denies that behavior is driven by addiction and that behavior’s consequences are the results of addiction. It denies the story of addiction and proposes an endless collection of counter-conspiracies.

It appears as those around the addict ignoring the addict’s use and the consequences of that use; as the narratives, tics, and habits through which the addict understands and acts out his or her use; and as the alternate version of reality that the addict and everyone around him or her shares in lieu of the reality of addiction. To paraphrase Baudelaire on the devil, denial’s best trick is to persuade us that addiction doesn’t exist.

No addiction could develop a more effective narrative of denial than the trade in exotic financial instruments that’s evolved over the last decade or so; no addiction could hope for more willing abettors than the financial press, regulators, and ratings agencies; and no addiction could depend on a more permissive enabler than the Federal Reserve Bank.

It’s difficult not to imagine the banking industry as jittery and unshaven, embarking on yet another unregulated derivative binge, telling us, its concerned partner, that we just wouldn’t understand what it’s like, how high the return can get, while its friends in the financial press and ratings agencies encourage it, scoffing at the very idea of risk.

And later that night, as it’s coming down, it’ll shout something at us about not really needing the $1.2 trillion in liquidity, but if the Fed’s offering, why not?, it’ll make the night that much better, only to face us the next morning, hungover and distractedly claiming none of it ever happened.

We’ll confront it with seemingly undeniable evidence of MERS, TARP, executive bonuses, and a ruined housing sector, and it’ll look betrayed, ask us how we could even say such a thing, and tell us that it’s none of our concern and that we just have to trust it, because the bills are paid, right? It’s not like it’s as bad as AIG or MF Global, it’ll say, which will lead to an impossible-to-follow tale of the prank it played on MF Global last night, and how that was like something that happened to Bear Stearns and Lehman Brothers once, and ending with the declaration that the Fed and the SEC would never let anything bad happen to the Banking Industry.

And what choice do we have? Maybe it’s not that bad. After all, if the banks really were insolvent, there would’ve been something on the evening news.

Tomorrow: The Addiction

Categories: #OWS, finance, guest post

Innovation, elevation, and space travel

Science Fiction writer Neal Stephenson recently wrote this essay entitled “Innovation Starvation” on how it’s too bad we don’t have an innovative culture any more. I kind of like and agree with some parts his essay, especially this:

Most people who work in corporations or academia have witnessed something like the following: A number of engineers are sitting together in a room, bouncing ideas off each other. Out of the discussion emerges a new concept that seems promising. Then some laptop-wielding person in the corner, having performed a quick Google search, announces that this “new” idea is, in fact, an old one—or at least vaguely similar—and has already been tried. Either it failed, or it succeeded. If it failed, then no manager who wants to keep his or her job will approve spending money trying to revive it. If it succeeded, then it’s patented and entry to the market is presumed to be unattainable, since the first people who thought of it will have “first-mover advantage” and will have created “barriers to entry.” The number of seemingly promising ideas that have been crushed in this way must number in the millions.

It’s similar to my reasoning for not googling something under discussion for at least 30 minutes, especially when it seems possible to reckon whether it’s true or not.

I would add this: it’s tempting to immediately gauge the competition when you have a new idea, especially a business idea. But if you develop it within yourself or a small group of people it will inevitably morph into something that is probably unrecognizable from the original idea, so with that in mind, googling the original idea is actually irrelevant anyway. Stephenson makes a point similar to this in his essay.

Stephenson goes on:

The illusion of eliminating uncertainty from corporate decision-making is not merely a question of management style or personal preference. In the legal environment that has developed around publicly traded corporations, managers are strongly discouraged from shouldering any risks that they know about—or, in the opinion of some future jury, should have known about—even if they have a hunch that the gamble might pay off in the long run. There is no such thing as “long run” in industries driven by the next quarterly report. The possibility of some innovation making money is just that—a mere possibility that will not have time to materialize before the subpoenas from minority shareholder lawsuits begin to roll in.

Today’s belief in ineluctable certainty is the true innovation-killer of our age. In this environment, the best an audacious manager can do is to develop small improvements to existing systems—climbing the hill, as it were, toward a local maximum, trimming fat, eking out the occasional tiny innovation—like city planners painting bicycle lanes on the streets as a gesture toward solving our energy problems. Any strategy that involves crossing a valley—accepting short-term losses to reach a higher hill in the distance—will soon be brought to a halt by the demands of a system that celebrates short-term gains and tolerates stagnation, but condemns anything else as failure. In short, a world where big stuff can never get done.

While I agree that people, especially within the context of large companies or government, are too short-sighted, I think this view is overly negative. On smaller scale, and in smaller companies, people do definitely take real risks (and pay for them sometimes).

But this essay is really about “doing the big stuff” and that’s where I’ll just have to argue against it altogether. Stephenson, like many sci-fi writers, is totally into the idea of space travel and is deploring the fact that we as a nation have turned away from it because of its expense and because we don’t want to take huge risks with money and people. Unlike in the good-old days of the Sputnik Era.

But I’d argue that the Sputnik Era was really about the Cold War and competition with the Russians, not space travel. This nostalgia is misplaced, similar to how people talk about family values and how great it was in the 1950’s, while ignoring the outrageous racism, sexism, and homophobia that existed then. It’s a revisionist view.

I’m not saying nothing cool happened in order to get a man on the moon, because clearly lots of cool stuff did happen. I’m just saying it happened in the context of a very serious us-versus-them mentality, where we were actively afraid of being blown up in a nuclear war, and I for one am not signing up for that again just so we can work together better.

More generally, Doing Something Big almost by definition means making sacrifices on other projects, so it makes sense that people who benefit from the chosen project think it’s awesome but other people not so much.

Going back to space travel: it’s a funny subject for conversation. When people talk about it they often experience elevation, which is my favorite recently understood emotion, and it means they transcend their normal existence. This seems to happen to young people and science fiction fans especially when talking about space travel, can happen to people listening to music, and used to happen to a lot of people when listening to Obama’s speeches.

Having been born and raised around science fiction and space lovers, I get this, and I can even summon up the accompanying elevated trance at will. But I also get that the idea of putting a huge amount of our resources into space travel, when we still haven’t figured out how to consistently feed people here on earth, is not completely reasonable.

I’m not arguing for no space travel, because there’s definitely a place for the basic scientific research that gets accomplished in the wake of cool, ambitious plans. But to Neil Stephenson I’d say, buddy there’s a pretty good reason this isn’t happening, and it’s not just because people aren’t innovative.

Categories: musing

Hey, Doocy apologized for fabricating part of Obama’s speech!

A few days ago my friend Michael Thaddeus wrote a guest post after noticing that Fox News reporter Steve Doocy had added three words, “Unlike some people,” to Obama’s line “I wasn’t born with a silver spoon in my mouth.”

This fabrication had the effect of making Obama appear to be making a snide reference to Romney. Indeed Doocy was talking to Romney on Fox News when he added the words. But the truth was that Obama had been saying the silver spoon line since 2009, as Thaddeus pointed out.

Moreover, the Washington Post and New York Post had picked up the line verbatim from Doocy, rather than checking the original source, and when Thaddeus had contacted them they had ignored his complaints. So that’s when he asked me to put up his guest post, which I did.

And what’s super cool is that it was picked up by a bunch of people who linked to my blog (ISPN Media, Deep Brain Media, Brobrubel’s blog, The Fifth Column, and FAIR), and quite a bit of twitter buzz for what I’m used to.

A bunch of other media outlets also picked this up who didn’t link to my blog (which is kind of ironic considering the post is about doing your job as a journalist) including USA Today, Media Matters, and the Daily Kos, after which the Washington Post corrected its Obama quote.

After that, the story got onto Talking Points Memo, and didn’t link to my blog but was attributed to Michael Thaddeus which later got shortened to MT for some reason. It was even the top story on Talking Points Memo for some time Sunday afternoon.

The ultimate (in terms of my kids thinking I’m cool) happened Monday evening though when the story was featured on the Colbert Report. Cool!

Oh yeah, and Doocy finally apologized on Fox News.

Blogging isn’t dead, people!!

Categories: news

Declaration of Linear Independence: the nerdiest thing you’ve ever seen

My friend Michael Thaddeus recently informed me of the existence of the Declaration of Linear Independence, written by mathematician David Grabiner. I will describe the document as a “re-imagining” of the original Declaration of Independence from the point of view of a set of vectors in some vector space which feel, for whatever reason, that their independence has been under attack (I’m considering inviting them to join Occupy).

I’m not really sure I can ethically ask you to read the entire document, due to the intense nerdiness of it which may cause the weaker among you to lose consciousness, but let me give you the flavor. Here’s the most famous sentence translated into vector-angst:

We hold these truths to be self-evident: that all nonzero vectors are created equal; that they are endowed by their definer with certain unalienable rights; that among these are the laws of logic and the pursuit of valid proofs; that to secure these rights, logical arguments are created, deriving their just powers from axioms; that whenever any argument becomes destructive of these ends, it is the right of the vectors to alter or to abolish it, and to institute a new argument, laying its foundation on such principles, and organizing its powers in such form, as to them shall seem most likely to reach the correct conclusion.

Whereas the original document listed grievances against King George III, this new one complains about Professor Eigen, who is a made-up guy personifying everything which is overbearing and repressive about eigenvectors, eigenspaces and eigenvalues. Here’s my favorite complaint:

He has restricted our freedom of movement by requiring us all to live in the same hyperplane, even though we cannot all fit in one.

Finally, the ending is really quite good for those of us who on the one hand remember our linear algebra and on the other hand sympathize with these vectors being denied their (linear) independence rights:

 In witness whereof we have signed our coordinates with respect to an appropriate orthonormal basis, and found them to constitute a triangular matrix with nonzero diagonal elements.
Categories: math

Online learning promotes passivity

Up til I took Andrew Ng’s online machine learning class last semester, I had two worries about the concept of online learning. First, I worried that the inability to ask questions would be a major problem. Second, I worried about the possibility of building up material. I could imagine learning a given thing online but the ability to sustain and build material over an entire semester seemed kind of unrealistic.

On the second point, I think I’m convinced. Andrew definitely taught us a real semester’s worth of stuff, and he built up a body of knowledge very well. I now communicate with my colleagues at work using the language he taught us, which is very cool.

On the first point about asking questions, however, I am even more convinced there’s a crucial problem.

I want to differentiate between two different kinds of questions to make my point. First, there’s the “I’m confused” type of question, where someone literally doesn’t get the point of something or doesn’t understand the notation or a step in an explanation.

One can imagine tackling this kind of question in various ways. For example, one can strive to be a really good teacher, which Andrew certainly is, or to explain things at a high level but shove the details into black boxes, which Andrew did quite a bit (somewhat to my disappointment, especially when linear algebra was involved). If neither of those two things is sufficient, and the class is really important and/or really common, one can imagine teaching a computer to anticipate confusion and to ask questions along the way to make sure the students are following, and to go back and explain things in a different way if not.

In other words, the first kind of “clarifying questions” can probably be dealt with by the online learning community over time.

But there’s a second kind, namely the kind of question where someone is not confused but rather asks a question for one of the following reasons:

  1. they want to know how a certain idea relates to something else they know about,
  2. they want to generalize something the teacher said,
  3. they want to argue against an approach or for another approach,
  4. they see a mistake, or
  5. they see an easier way to do something.

Almost by definition, the above kinds of questions aren’t anticipated by the teacher, but the fact that they are asked almost always improves the class, certainly for the student in question but also for the other students and the teacher.

For example, one semester I taught three sections of 18.03 (exhausting! and I was pregnant!), which is a calculus class at M.I.T., and I remember thinking that in every single class one of the students made a remark or asked a question that I learned something from. It got to the point that, the third time through the same material, I’d be waiting for someone to explain how I should be teaching it. I loved that the students there are so smart but also so engaged in learning.

And that’s what I’m worried about- the engagement. When you embark on an online class, the best you can hope for is that you learn something and that you don’t get hopelessly confused. And that’s cool, that you can learn something, for free, online. But what you can’t do is what I’m worried about, and that’s to get instant feedback and discussion about some idea you had in the categories above.

I’m definitely one of those people who asks questions of the second type, and although I may sometimes annoy my fellow students, I really feel like the active engagement I pursue by coming up with all sorts of crazy comments and ideas and questions is what made me capable of doing original and creative things. For me, the most important part of my education was that training whereby I got to ask questions in class and got smart teachers who liked me to do so and would talk to me about my ideas.

How can that possibly happen with online learning? I’m afraid it can’t, and I’m afraid we will be training people to receive information rather than to engage in creation.

I imagine that in 200 years, almost everyone will be taught online, hooked into the machine and pumped up with knowledge. It will be only the elites who will have access to real live people to teach them in person, where they will be taught not only the material but also how to argue against a point of view and to propose an alternate approach.