Friday, November 16, 2012

YALE UNDERGRAD DATA GEEKS SET SIGHTS ON SCHOOL REFORM …using iPads + plain white paper

Online survey company Panorama Education’s  business has exploded, spurred mainly by a contract with the Los Angeles Unified School District.

by Thomas MacMillan | The New Haven (CN) Independent | http://bit.ly/XJ6nrS

Nov 13, 2012 11:30 am  ::  With a few taps on an iPad, a New Haven principal may soon determine if her teachers are reaching 9th-grade C-student girls as well as 10th-grade boys who get As.

That’s the possibility presented by three fresh-faced entrepreneurial undergrads at Yale.

Panorama Education, their burgeoning new educational survey company, is poised to win the contract to conduct the next “school climate” survey for the Board of Ed.

Members of the Board of Ed’s Administration/Finance Committee this week were impressed by an iPad-augmented presentation on Panorama’s services. They recommended that the Board of Ed approve Panorama’s bid. The full board will vote on the matter on Tuesday night.

Panorama also emerged as the “clear favorite” of the school survey committee, said Assistant Superintendent Garth Harries.

As part of citywide school reform efforts, the Board of Ed (BOE) has for three years conducted school climate surveys. The school system gathers data on how students, parents, and teachers perceive their school with regard to factors like safety, collaboration, and engagement.

The intention is to determine areas of strength and weakness to guide reform efforts in each school. It’s part of a strategy of using data to help measure and augment the city’s ambitious school-reform drive.

Panorama will “take us to the next level,” BOE staffer Carolyn Ross-Lee (at center in top photo) told committee members at their meeting this past Monday night. She said Panorama offers a number of benefits over previous survey companies. She pulled out an iPad to demonstrate how Panorama presents survey data in an interactive, secure, web-based interface. As she tapped the screen, colorful bar graphs popped up under her fingers.

Click here to tap through the interface yourself, using publicly available data from a California school system Panorama has worked with.

image

screenshot of LCUSD survey results

What’s more, Panorama’s bid came in far lower than the nearly $100,000 the BOE spent to conduct the surveys this year, Ross-Lee said. Panorama’s bid is for between $52,000 and $60,000, depending on which features the BOE chooses.

The surveys are usually conducted in January, with the results available in May. In the intervening months, Board of Ed staff labor to crunch all the numbers and produce reports.

Aaron Feuer, (smf: son of Assemblyman and L.A. City Attorney candidate  Mike Feuer) Panorama’s CEO, said his company can have data available online in a customized web interface within just a couple of days after collecting surveys.

“They have they seem to have the ability to enable us to do more to work more quickly to produce reports on our surveys and to provide better and clearer information to all of our different stakeholders,” Harries said later.

“I don’t see any downside,” Michael Nast (at right in top photo), one of two members of the Administration/Finance Committee, said at Monday’s meeting.

Elizabeth Torres (at left), the other member, said she likes the fact that Panorama is a local company.

Ross-Lee predicted that Panorama would be easily available to the Board of Ed for customer support. She described the company as young and “hungry,” but with “thick resumes.”

697 Schools, 6 States

Feuer (pictured), Panorama’s 21-year-old CEO, said he has had to deal with some skepticism about his youth as he has built up his company over the last year. He said he had to convince one prospective client that he’s not storing Panorama’s servers in his dorm room. He’s not. Panorama taps into massive cloud-based servers to do its number-crunching.

And the company headquarters are not in a dormitory, Feuer said. Panorama recently moved from the Yale Entrepreneurial Institute on Whitney Avenue to Yale Entrepreneurial Society at the corner of Elm and York streets. On a recent snowy afternoon, Feuer and two co-founders sat down at the Au Bon Pain across the street and shared the Panorama creation story.

When he was in high school in Los Angeles, Feuer served on California’s statewide student council, which meant he got to travel around the state visiting different schools and trying to figure out how to improve them. He found that student surveys helped everyone, he said. When students were able to give their teachers feedback they were more engaged, and the teachers liked it too.

The problem, Feuer found, is that schools tend not to have the technology to do such surveys quickly and easily. During his freshman year at Yale, Feuer got money from the university to build a computer system to crunch survey data and create reports. He got some student councils in California to use the new system, but quickly found that it wasn’t very effective without buy-in from teachers and parents.

Feuer picked up the project again this school year. He said he was inspired in part by a Gates Foundation-funded report showing that school surveys are an essential part of improving education, and by a realization that school districts were spending hundreds of thousands of dollars to conduct surveys. He figured he could do it cheaper and better. He formed Panorama with three other Yale undergrads, all seniors, all 21-years-old.

In April, Panorama landed its first client: The La Cañada Unified School District in California. In just the few months since, business has exploded, spurred mainly by a contract with the Los Angeles Unified School District. Panorama is now working with 697 different schools in six states, Feuer said.

In Connecticut, Teach For America has hired Panorama to survey students about its teachers three times a year. The company is also working with the state, which is piloting a new teacher-evaluation system.

It’s a been a matter of being at the right place at the right time, with the right technology, Feuer said. And good luck, he added.

Cloud Tapping

Part of Panorama’s good timing is that it’s entering a field where there is not a lot of competition. In LA for example, no other company existed that could do what Panorama does, Feuer said. “No one else does reports like this for teachers. No one else does this at all.”

Panorama takes advantage of a number of technological advancements to both cut costs and provide services others don’t offer, Feuer said.

For example, the traditional customized fill-in-the-bubble sheets used by many surveys can cost several dollars per page. “We use plain white paper,” Feuer said. Panorama’s survey forms are printed out on regular paper. The completed surveys are scanned in as PDFs (pictured) that can be digitally analyzed for question responses. It doesn’t matter if the responder uses a number-two pencil, a pen, or a highlighter or even if they fill in the bubble with an “x” or a check mark..

Survey responders can also take the surveys by computer and, in another Panorama innovation, by mobile phone. Panorama will use a robocall system to remind parents who haven’t completed the survey to do so. That hasn’t been done before in New Haven, Feuer said.

To process all the gathered data, Panorama taps into Amazon’s massive cloud-based computing service. There’s no need for Panorama to have its own bank of servers, Feuer said. It can access as much computing power as it needs on the cloud.

Once the surveys are all in, Panorama will be able to turn around the data in a matter of days, producing PDF and interactive online reports for the Board of Ed, Feuer said. That’s a change from past years, when school system staff have spent months crunching data to produce their own reports, according to Harries.

“We’ve had to do a lot of work to create the reports,” Harries said. It has taken a lot of time and effort to put the information into a more “digestible” format.

Panorama’s reports will be available online to administrators and to the general public. Harries said the school district will continue its commitment to “a high degree of transparency” by much of the data available to the public.

Previously, the Board of Ed has contracted with “a more conventional research shop” to do the surveys, a company that’s not designed to be as “public-facing” as Panorama, Harries said. “These guys offer a specialized service geared exactly” toward schools, he said.

Silver, Sabermetrics, Satisfaction

Unlike those stodgy “conventional research shops,” Feuer and his fellow 21-year-old colleagues have hardly known a world without Google and Wikipedia. They’ve grown up with seemingly infinite streams of data available on demand in beautiful, interactive packages. That’s the sensibility and the expectation that they are bringing to the field of public education surveying. They’re looking to to upend the industry the way New York Times polling whiz Nate Silver confounded political pundits during the recent presidential election.

Silver used statistics to glean previously unknown insights from stacks of political polls. He condensed massive amounts of polling data into clear, interactive, and ultimately spot-on information about the state of the race. The New York Times then presented the information in an elegant, interactive website, essentially making conventional political prognosticators obsolete.

“What The New York Times does for data, if we can do that for schools ...” Feuer said. Panorama aims to present complex information in a beautiful and useful way, just like Silver’s blog on the Times website.

“This is our Nate Silver on the team,” Feuer said, pointing to Xan Tanner (pictured), Panorama’s director of analytics and research. A religious studies major from Boulder, Tanner admits to being a big fan of Silver, who got his start analyzing baseball stats. During his time at Yale, Tanner has been doing statistical work for the university’s basketball team, using sabermetrics on the fly during games to “optimize the roster” for victory.

Feuer and Tanner, along with marketing director David Carel, are all graduating seniors. They said their professors have all been very understanding about their sudden absorption into a burgeoning business. “Luckily we were all good students for the first three years,” Tanner said.

Panorama has a total of seven employees and has begun to bring in some money, although Feuer, Tanner, and Carel are not yet taking salaries. The current plan is to keep the company in New Haven after graduation, and continue to expand. Asked about Higher One, another Yale start-up that’s found great success bringing computing power to education, Feuer said he would hope Panorama follows its trajectory.

“We’ve had investment offers,” Feuer said. “We’re enjoying bootstrapping so far.”

The company has so far been funded by a $25,000 grant from Yale and a $25,000 prize from a contest held by the university.

While Panorama’s services could be applied to other fields, Feuer said he’s committed to focusing on education. It just wouldn’t be very satisfying to optimize, say, customer satisfaction surveys for the airline industry, he said.

“We could spend a lifetime fixing education,” he said. “There are 15,000 school districts to go in this country.”

No comments: