29 April 2011

Large deviations Take 2

This week a tornado ripped through Tuscaloosa, Alabama, leaving 38 confirmed dead. That storm in all killed hundreds.

This article from the NY times discusses how predicting tornadoes is still very difficult. There are many factors, and it still isn't clear to meteorologists exactly when a tornado will form and come down to the earth.

I grew up with tornadoes, and when I moved to California I thought earthquakes were a lot scarier. It is true that earthquakes kill many more people around the world than do tornadoes. And earthquakes have had serious consequences even in places with amazing infrastructure, like we saw recently in Japan. At the same time, tornadoes that can hit at any time in any place-- as long as "conditions are right"-- make them a difficult problem for scientists to figure out.

As storms become more often and more severe in the world, I would like to see us put more resources toward understanding them-- both by collecting new and more measurements, and by analyzing old data about these storms. We won't be able to divert them, and we won't be able to stop their destruction; but if we can warn people ahead of time, we can save lives.

25 April 2011

Beauty and Counting

Sometimes enumeration is beautiful! But engineers don't like having to enumerate everything, because that takes a long time.

There are 892 ways to partition a 3x4 grid into unit rectangles. Thanks to angichau for the link.

14 March 2011

Japan earthquake and large deviations

The New York Times has an interesting article today about how Japan and North America came closer together after the devastating earthquake last week.

A very important area of study in modeling is that of large deviations theory. When we collect data in order to model something-- in order to predict earthquakes, for example-- we may not get very many data points for rare events, if any at all. Researchers in this area work on theory that allows for principled extrapolation to model and predict rare events.

From the article:

"What is perhaps most surprising about the Japan earthquake is how misleading history can be. In the past 300 years, no earthquake nearly that large — nothing larger than magnitude-eight — had struck in the Japan subduction zone. That, in turn, led to assumptions about how large a tsunami might strike the coast.

“It did them a giant disservice,” said Dr. Stein of the geological survey. That is not the first time that the earthquake potential of a fault has been underestimated. Most geophysicists did not think the Sumatra fault could generate a magnitude-9.1 earthquake, and a magnitude-7.3 earthquake in Landers, Calif., in 1992 also caught earthquake experts by surprise.

“Perhaps the message is we should re-evaluate the occurrence of superlarge earthquakes on any fault,” Dr. Stein said."

14 December 2010

when you know why and shifting the paradigm

A friend of mine visited me in Madison last spring. She is a community college biology professor near Detroit. The week after she visited, she was teaching her students about levers for anatomy class. So while I was working at school, she spent some time trying to understand these simple machines.

She and I talked about how we both have a hard time using information we have learned until we feel there are no gaps in our understanding. For me, if I wasn't careful at understanding why something is the way it is, I have to take giant leaps of faith in actually applying it. And being a skeptic, I'm not particularly good at leaps of faith! You can ask my sewing teacher-- I'm always questioning the instructions she gives me. But sometimes, all the inside-out seams and pattern matching suddenly make sense, and I realize she was right all along!

When some fundamental thing just clicks, it's not always obvious why things suddenly make sense. We all have a paradigm which we accept, and once something new fits into that paradigm, we feel it "click." But this is also a hindrance to shifting the paradigm itself.

I have been reading a very good book about incorporating Structured Controversy into the classroom, by Johnson Johnson & Smith 1996. Intellectual conflict is believed to be a central part of learning to have an open mind and to be a critical thinker. Piaget in 1950 proposed that cognitive dissonance-- or inconsistency among a student's understandings of the world and what they see and hear from others-- is what motivates transitions from one level of reasoning to higher level which is more broad and flexible, and which causes "a shift from egocentrism to accommodation of other people's
perspectives."

It should be the lifetime goal of the researcher to achieve a balance between on one hand having a paradigm that allows you to incorporate and use new knowledge efficiently and on the other hand being open to shifts in your paradigm in order to follow the really breakthrough ideas.

11 August 2010

when a proof becomes a proof

Just this week, a researcher at HP labs named Vinay Deolalikar has claimed to solve the P ≠ NP problem. It has been conjectured long ago that P ≠ NP, and probably every researcher in algorithms, signal processing, and computer science has some work that relies on the belief that P ≠ NP, so if he has proved it there will be world wide celebrating. It is also one of the Clay Math prize problems, so (again, if the proof is accepted) Deolalikar will win the million dollar prize.

What I find so exciting is now the process of accepting or rejecting the proof as a community of researchers. This blog post discusses possible issues in the proof that have been raised by various computer scientists and mathematicians. Hopefully this process will help the public understand something about the way that math and research really works-- as that blog quotes from mathematician Yuri Manin, "A proof only becomes a proof after the social act of accepting it as a proof." Engineering, science and even math are social endeavors in many ways, but the most important is that ideas only begin to impact the world when the whole community begins to understand and accept them. The point in time when the community embraces the ideas, and begins to voice the implications enthusiastically, is the point at which the idea really guarantees its spot in the library of scientific knowledge.

25 May 2010

compressed sensing

I created this audio illustration of compressed sensing as part of a demo for an NPR bit about compressed sensing, which Jordan Ellenberg was asked to participate in after the NPR folks saw his Wired article. Well yesterday the piece was on All Things Considered! You can listen here.

05 April 2010

Authenticity

I watched this talk by Jesse Schell, a professor at CMU. In it he talks to game developers about how games are moving forward into the future. He has some very interesting ideas about bringing gaming into our every day lives-- even to help us become better people. But what I found most interesting was his reference to a book called "Authenticity." Here is a transcript of this part.


"We talk about realism, and we know yeah realism can make your game better sometimes if it's the right kind of realism. But normally we're thinking about visual realism. There's a lot of other kinds of realism that can come into a game. ... Guitar hero you play on a real guitar, and webkins with a real stuffed animal, and even the X-Box achievements is outside the reality of the game-- there's a higher level scoring system.

"But it's not just us that were snuck up on by this reality thing, and it's not just happening to us. Go look at TV-- the people on TV, their heads are spinning--everything has turned into reality TV. Go to the grocery store-- it's not just groceries anymore, it's organic groceries-- more genuine, more real groceries. Go to McDonald's, well you could get a Big Mac, OR you could get a real burger, the Angus burger, made with real this and that and whatever. Everything is suddenly about reality.

"Now, what's going on? Is this just how it's always been? Well I found this really interesting book, called Authenticity, by the guys who wrote the Experience Economy. Gilmore and Pine put forth this interesting concept-- that the most valuable thing in products today is "Are they real, are they authentic"-- which is a bold hypothesis. Then they go further and they say, well, why is it? Why now? It didn't always used to be this way-- certainly that's not what sold stuff in the 80s. It wasn't reality and authenticity that sold stuff then.

"What is it now that people are demanding reality and demanding authenticity? They're arguing that all this virtual stuff that's been creeping up on us over the last 20 years has really cut us off from nature. We're cut off from nature, we're cut off from self-sufficiency. We couldn't be self-sufficient if we wanted to. We don't know how to do it. We live in a bubble of fake bullshit, and we have this hunger to get to anything that's real-- Even if the best we can do is a Starbucks mocha with real Swiss chocolate, we'll take it, Oh it's real! Look how real that seems to me relative to what I'm used to.

"So there's this idea that maybe there's this hunger for reality. You might believe it or not, but once I read this authenticity book, I started seeing it everywhere, everywhere I looked--every ad was about their product being the real one. And I go to see the movie Avatar, and you might say Oh Avatar, that was cool special effects and that was really a lot of fluff, but it's the movie that's made the most money of all time and it's got a good shot at best picture-- What's this movie about? This movie is about the question of: We know technology cuts us off from the real world, and the movie addresses the question of can we then use that technology in order to penetrate back into reality and back into something genuine. So it may be this movie is not just fluff, it may be this movie is resonating with something important for people."