Hacking to Improve Disaster Response with Qlik, Medair and Gnip

At Gnip, we’re always excited to hear about groups and individuals who are using social data in unique ways to improve our world. We were recently fortunate enough to support this use of social data for humanitarian good first-hand. Along with Plugged In to Gnip partner, Qlik, and international relief organization, Medair, we hosted a hackathon focused on global disaster response.

The hackathon took place during Qlik’s annual partner conference in Orlando and studied social content from last year’s Typhoon Haiyan. Historical Twitter data from Gnip was paired with financial information from Medair to give participants the opportunity to create new analytic tools on Qlik’s QlikView.Next BI platform. The Twitter data set specifically included Tweets from users in the Philippines for the two week period around Typhoon Haiyan in November of 2013. The unique combination of data and platform allowed the hackathon developers to dissect and visualize a massive social data set with the goal of uncovering new insights that could be applied in future natural disasters.

For example, one team used Gnip’s Profile Geo Enrichment to map Tweets from highly-specific areas according to keywords such as “water”, “food” or “shelter”. Identifying trends in which geographic areas have greater needs for certain types of aid could provide a model for improving disaster response times and efficiencies. Another team analyzed spikes in the use of certain hashtags as a way to uncover actionable data being shared about the residual impacts of the typhoon. The developers’ efforts were all brought to life through the QlikView.Next visualization platform, making the resulting insight discovery process very intuitive and easy to comprehend. The results were pretty amazing, and here’s a look at the winning app!

Hackteam1

“With Gnip’s support, we were extremely honored to be able to work with Medair for this year’s Qlik Hackathon and help them use data to further the impact of the great work they are doing worldwide,” said Peter McQuade, vice president of Corporate Social Responsibility at Qlik. “It provides Medair with an application that supports their fundraising efforts and ultimately helps change our world by maximizing the impact of their work with some of the world’s most vulnerable people.”

We would like to express our sincere thanks to both Medair and Qlik for inviting us to participate in such a meaningful cause. The hackathon produced new social data applications that Medair and first responder teams may be able to use in future disaster response efforts to better help those immediately affected. As for Gnip, we can’t wait to see how social data will be applied toward other humanitarian causes moving forward!

Big Boulder is Definitely Going to be Big

Big Boulder is two weeks away and everything is really coming together beautifully. The world’s first conference on social data already has top-notch speakers such as Ryan Sarver of Twitter, Joe Fernandez of Klout and Sean Bruich of Facebook. But…we’re not done yet! Today we’re excited to announce ten new speakers who are leading the world in social data innovation.

We’re excited to announce:

Our conference hotel, the St Julien is completely booked for Thursday night, but we’ve made accommodations at other nearby hotels. See our venue page for more details!

 

Tebow Time Scores in Social Media

Wow, what a game!  If you missed the instant classic that was the Broncos/Steelers overtime game tonight, check out the recap.

When Tim Tebow connected with Demaryius Thomas on an 80-yard touchdown pass on the first play of overtime, we saw a noticeable spike in the overall volume of social media messages flowing through the Gnip platform.

Tebow Time!

Spike in Social Media Mentions when Tim Tebow Throws Winning Touchdown against the Steelers

Gnip is Headed to Defrag

 


Just wanted to give everyone an update on the Gnip events front. We are gearing up for our appearance at the upcoming Defrag Conference taking place in our neighboring town of Broomfield, Colorado at the Omni Interlocken Resort on November 9th and 10th. We are excited to be a sponsor of this year’s event that will focus on the exploration of the tools and technologies that intersect around the data deluge.

 

At the conference, Gnip’s very own Chris Moody (@chrismoodycom) will be featured as a keynote speaker, where he will discuss, Emerging Use Cases for Big Social Data. During this presentation Chris will highlight the ways that social data is being used to drive innovation across a variety of industries from Financial Services and Emergency Response to Local Business and Social CRM. Chris will also unveil the importance of having the right data for the right need with the debut of Gnip’s Social Data Analysis Grid. Be sure to catch Chris’ presentation on November 9th from 11:30am to 11:45am.

With the conference is just around the corner, we wanted to extend everyone a discounted registration code on behalf of Gnip. To receive a 20% discount on your registration, contact sales@gnip.com by November 1st.

Finally, Gnip’s Director of Sales, Fred Funke (@funkefred) and Data Scientist, Scott Hendrickson (@drskippy27) will also be at the conference.

Let us know if you will be attending, we’d love to chat. See you at Defrag!

The VMAs, Lady Gaga and Data Science

Hi everyone. I’m the new Data Scientist here at Gnip. I’ll be analyzing the fascinating data that we have coming from all of our varied social data streams to pull out the stories, both impactful and trivial, that are flowing through social media conversations. I’m still getting up-to-speed but wanted to share one of the first social events that I’ve dug into, the 2011 MTV Video Music Awards.

Check out the info below and let me know in the comments what you think and what you’d like to see more of.  And now, on with the show…

3.6M Tweets Mention “VMA”

The volume of tweets containing “VMA” rose steadily from a few hours before the VMA pre-show was broadcast, up to the starting of the pre-show at 8:00 PM ET (00:00 GMT) and remained fairly strong during the event. It trailed to low volume within the hour after the VMA broadcast ended at 11:15 PM ET (03:15 GMT). Tweets mentioning “VMA” totaled 3.6M during the 7 hours surrounding and including the VMA broadcast.

 

Lady Gaga Steals the “Tweet” Show

The largest volume of tweets for an individual artist are the mentions of “gaga.” Lady Gaga performed early in the show and the surge of tweets during her performance surpassed 35k tweets per minute for about 8 minutes. Again in the second half, Lady Gaga tweet volume briefly jumped above 50k per minute. Tweets mentioning “gaga” totaled 1.8M during the 7 hours surrounding and including the VMA broadcast.

As you can see in the chart below, other artists that garnered significant tweet volumes included Beyonce’, Justin Beiber, Chris Brown, Katy Perry and Kanye West. Perry, West and Brown got a lot of attention during their appearances, while Justin Bieber and Lady Gaga lead the counts in volume by maintaining a fairly steady stream of tweets during the broadcast.

Term Representation of Tweets Sampled
VMA 44 %
Lady Gaga 21 %
Beyonce 16 %
Justin Bieber 10 %
MTV 9.2 %
Chris Brown 8.0 %
Katy Perry 5.6 %
Kanye West 4.8 %
Jonas 3.5 %
Taylor Swift 2.1 %
Rihanna 1.1 %
Eminem 0.55 %
Michael Jackson 0.18 %
Ke$ha 0.17 %
Cher 0.14 %
Paramore 0.12 %

 

 

 

Contrasting, it is interesting to note that Beyonce’ and Chris Brown gained most of their tweet attention around their performances with very larger surges in tweet volume. Beyonce’s volume–another Beyonce’ bump–continues after her performance as twitter users absorb the news of her pregnancy.

 

 

One surprise that emerges from looking for other artists connected to the VMAs was Michael Jackson’s tweet volume. While Jackson gleaned many Retweets after winning the King of the VMA poll, he also received a large number of natural tweets lamenting his passing and celebrating his past successes.

Methodology

The free-form text and limited length of twitter messages creates a number of challenges for monitoring an event via twitter comments. People refer to the event differently and focus on different parts of the event. There will be spelling variations and differences in idioms and nicknames used to describe people and performances. Do we search for “Bieber”,”Beiber” and “Justin”?  Will tweeters use “Beyonce” or Beyonce'”? Knowledge of what we are monitoring is required; preparing tools to adapt things we learn during the events is also essential to getting good results.

One effective strategy is to use one or two tokens to identify tweets related to the event. The objective is to choose terms that we know are related to the event, that won’t be widely used outside the event, and that will give a representative sample–diverse and with sufficient volume. Once we have started to collect the event-focused twitter sample, we can look for relevant terms correlated with the filter term to find out what else people are tweeting about during the event.

Hope you enjoyed this first post. Look for more to come.

 

Gnip Wins Esprit Big Ideas Award

November 3rd will mark the 27th anniversary of the Esprit Entrepreneur Awards. This signature event, hosted by the Boulder Chamber, has been Boulder Valley’s premier event celebrating the success and vitality of our local entrepreneurial community and its leaders. We’re excited to announce that Gnip has been selected as the winner of one of two Esprit Big Ideas Awards. We also wanted to give a big shout out to our former office mates Next Big Sound who will receive the other Big Ideas Award. Congratulations to Alex White, Samir Rayani, David Hoffman, and the entire Next Big Sound team!

We would also like to congratulate the winners in other categories of the Esprit awards. We are so proud to be honored among such a distinguished group of innovators within the Boulder community:

Thanks to the Boulder Chamber for their continued support and dedication to cultivating the entrepreneurial spirit that thrives in Boulder Valley. Boulder has become a hotbed for entrepreneurs and an amazing incubator for startups. We’re proud to be a member of this amazing community.

Awards will officially be presented at the 27th annual Esprit Entrepreneur awards event at 5:30 p.m. on Thursday, Nov. 3 at the Omni Interlocken Resort in Broomfield. We would love to see you there. Registration information can be accessed here.

Dreamforce Hackathon Winner: Enterprise Mood Monitor

As we wrote in our last post, Gnip co-sponsored the 2011 Dreamforce Hackathon, where teams of developers from all over the world competed for the top three overall cash prizes as well as prizes in multiple categories.  Our very own Rob Johnson (@robjohnson), VP of Product and Strategy, helped judge the entries, selecting the Enterprise Mood Monitor as winner of the Gnip category.

The Enterprise Mood Monitor pulls in data from a variety of social media sources, including the Gnip API, to provide realtime and historical information about the emotional health of the employees. It shows both individual and overall company emotional climate over time and can send SMS messages to a manager in cases when the mood level goes below a threshold. In addition, HR departments can use this data to get insights into employee morale and satisfaction over time, eliminating the need to conduct the standard employee satisfaction surveys. This mood analysis data can also be correlated with business metrics such as Sales and Support KPIs to identify drivers of business performance.

Pretty cool stuff.

The three developers (Shamil Arsunukayev , Ivan Melnikov  and Gaziz Tazhenov) from Comity Designs behind this idea set out to create a cloud app for the social enterprise built on one of Salesforce’s platforms.  They spent two days brainstorming the possibilities before diving into two days of rigorous coding. The result was the Enterprise Mood Monitor, built on the Force.com platform using Apex, Visualforce, and the following technologies: Facebook API (Graph API),  Twitter API, Twitter Sentiment API, LinkedIn API, Gnip API, Twilio, Chatter, Google Visualization API. The team entered their Enterprise Mood Monitor into the Twilio and Gnip categories. We would like to congratulate the guys on their “double-dip” win as they took third place overall and won the Gnip category prize!

Have fun and creative way you’ve used data from Gnip? Drop us an email or give us a call at 888.777.7405 and you could be featured in our next blog.

We're off to Dreamforce!

There’s always a lot going on here at Gnip, but this week is especially packed with the team looking to make a big splash at Salesforce.com’s annual Dreamforce event. Salesforce is obviously a huge player in the software space and the theme of this year’s Dreamforce is “Welcome to the Social Enterprise” which fits really nicely with what we do.

At the conference, we’ll be speaking at two sessions and sponsoring the Hack-a-thon. In the first presentation, Drinking from the Firehose: How Social Data is Changing Business Practices, Jud (@jvaleski) and Chris (@chrismoodycom) will discuss the ways that social data is being used to drive innovation across a variety of industries from Financial Services and Emergency Response to Local Business and Consumer Electronics. They’ll also give a glimpse into the technical challenges involved in handling the ever-increasing volume of data that’s flowing out of Twitter every day. If you’re at Dreamforce, this session is on Tuesday (8/30) from 11am to noon in the DevZone Theater on the 2nd floor of Moscone West.

In the second presentation, Your Guide to Understanding the Twitter API, Rob (@robjohnson) will talk through the best ways to get access to the Twitter data that you’re looking for, examining the pros and cons of the various methods. You can check out Rob’s session on Tuesday (8/30) from 3:00 to 3:30 in the Lightning Forum in the DevZone on the 2nd floor of Moscone West.

And finally, we’re sponsoring the Hack-a-thon where teams of developers will create cloud apps for the social enterprise using Twitter feeds from Gnip and at least one of the Salesforce platforms (Force.com, Heroku, Database.com). The winning team stands to take home at least $10,000 in prize money. We’re really excited to see the creative solutions that the teams develop! All submissions are due no later than 6am on Thursday (9/1), so sign up now and get going!

Want to meet up in person at Dreamforce? Give any of us a shout @jvaleski, @chrismoodycom, @robjohnson, @funkefred.

Incredible Innovation in Boulder Valley – Results from the IQ Awards

One of the reasons that we at love working in the Boulder Valley is because of the incredible and talented companies that make up the local business ecosystem. Given the depth and quality of innovative organizations that make Boulder their home, we’re extremely excited and very honored to announce today that we’ve won the Boulder County Business Report (BCBR) Innovative Quotient (IQ) Award for Social Media/Mobile Applications.

Presented by the BCBR, the IQ Awards is an annual event that honors the most innovative new products and services developed by companies and organizations, with a special emphasis on advanced technologies, innovations within a particular business sector and sustainable business practices.

Congratulations to all of last nights winners, with a big shout out to our fellow Foundry family member Standing Cloud who won the award in the Internet/Web category. Below is a list of companies that were recognized and their respective categories:

     

  • Green/Sustainability: OPX Biotechnologies Inc.
  • Social Media/Mobile Applications: Gnip Inc.
  • Nonprofits: Safehouse Progressive Alliance for Nonviolence
  • Software: Accurence Inc.
  • Natural Products: Cooper Tea Co. and Third Street Chai
  • Sports & Outdoors: Crescent Moon Snowshoes
  • Consumer Products & Services: Agloves
  • Internet/Web: Standing Cloud Inc.
  • Innovation Accelerator: Boulder Innovation Center and Longmont Entrepreneurial Network
  • Business Products & Services: Radish Systems LLC



Thank you to the Boulder County Business Report for recognizing the amazing innovation that exists in our community and congrats again to all of our fellow winners! Keep the innovation flowing, Boulder.

For more info, check out our press release.

 

Get your Hack On! Gnip Helps Power an App Developed at the 2011 TechCrunch Disrupt Hackathon

Over 500 individuals recently gathered in New York City for this year’s TechCrunch Disrupt Hackathon. This annual event, fueled by pizza, beer, and Red Bull, features teams of die-hard techies that spend 20 hours, many without sleep (hence the Red Bull), developing and coding the next big idea. Participants compete in a lightning round of pitches in front of a panel of judges with the winners receiving an opportunity to pitch on the main stage at the TechCrunch Disrupt Conference in front of more than 1,000 venture capitalists and industry insiders.

We are excited that one of the apps that was developed at the 2011 Hackathon was powered by Gnip data! We love it when our customers find new and creative ways to use the data we provide.

Edward Kim (@edwkim) and Eric Lubow (@elubow) from SimpleReach (@SimpleReach), which provides next generation social advertising for brands, put a team together to develop LinkCurrent, an app powered by Gnip data and designed to measure the current and future social value of a specific URL. When fully developed, the LinkCurrent app will provide the user with a realtime dashboard illustrating various measures of a URL’s worth — featuring an overall social score, statistics on the Klout Scores of people who have Tweeted the URL, how many times the URL has been Liked on Facebook and posted on Twitter, and geo-location information to provide insight into the content’s reach. Call it influence-scoring for web content.

The hackathon team also included Russ Bradberry (@devdazed) and Carlos Zendejas (@CLZen), also of SimpleReach, Jeff Boulet (@properslang) of EastMedia/Boxcar (@eastmedia/@boxcar), Ryan Witt (@onecreativenerd) of Opani (@TheOpanis), and Michael Nutt (@michaeln3) of Movable Ink (@movableink)– Congratulations to everyone who participated! You created an amazing app in less than 20 hours and developed a creative new use for Gnip data. I highly encourage all of you to check it out: www.linkcurrent.co

Have fun and creative way you have used data delivered by Gnip? We would love to hear about it and you could be featured in our next blog. Drop us an email or give us a call at 888.777.7405.