Big Boulder 2013

Big Boulder’s back for 2013 and better than ever.

The leaders in social data: Facebook, Twitter, Tumblr, Foursquare, Automattic, Disqus and many more are descending on Boulder again this summer to talk about the future of their platforms. Last year was a huge success and the expectations this year are even higher. We have a line-up that will deliver!

Headshots for Big Boulder

We’ll go deep into Asia and Latin America with speakers from China, Brazil and Japan, including the CEO of LINE, one of the fastest growing social networks on the planet. We’ll hear about non-traditional applications of Social Data with discussions on Finance, Government, Academic Research and Data Science. And to help us make sense of it all, we’ll have industry analysts discussing their views of the future. See the agenda and speakers pages for all the details.

In addition to all the great topics covered in the sessions, we’ve left plenty of time for networking with others in Social Data, including sunset cocktails with views of the Flatirons, a bicycle pub crawl, and since this is Boulder after all, morning yoga and hiking.

Big Boulder is an invite-only event for the leaders in the social data ecosystem. Space is filling up quickly so if you’re still thinking about it, sign up now before we hit capacity. Interested in coming but haven’t been invited? First check out our blog post about social data vs. social media. If you’re all about social data, email bre@gnip.com for information.

Big Boulder: Measuring Engagement on Facebook with Sean Bruich

An interview with Sean Bruich, head of measurement and Graham Mudd, head of measurement market development both at Facebook, about measuring engagement on Facebook.

Sean Bruich and Graham Mudd of Facebook

“Something’s wrong when the guys at Facebook are more dressed up than everyone else here,” – Chris Moody said before introducing Sean Bruich and Graham Mudd of Facebook.

The highly anticipated talk kicked off with the measurement issues marketers face online, specifically with Facebook. As Sean put, Facebook believes in solving measurement issues that every marketer is facing and allowing them to understand how online media can work for their businesses. As many marketers and brands attempt to brave the social media marketing ecosystem, it’s important to educate them on how this ecosystem can impact their business on a bottom-line level. Sean clearly put, it’s in everyone’s best interests to solve this problem and it’s very much at the forefront of Facebook’s plans. As a platform company, Facebook believes syndicating information can propel their business, however they want marketers to be able to engage with other platforms as well.

But how do companies attempt to navigate this ecosystem? Graham says it’s all about specialization. Facebook possesses a deep level of it that allows for truly deep measurement. Graham also states, “We can’t do it on our own.” Both Graham and Sean emphasized balancing innovation with standardization. Facebook wants and needs the help of other companies like Gnip to tell them what information they want to see and how they could use it better. But it’s not just about online. Marketers want to know about its offline effect:  how it incorporates into their business plan down the line and how it affects their bottom line.

Sean says traditional measurement hasn’t kept up with the technology that consumers are using. The big questions aren’t being answered. While developer communities are working towards that very quickly, there is still room for improvement on how ROI and marketing spend online fit into the marketing mix.  As in industry, we’re not answering the big questions that marketers need to know to justify spend and a presence online.

Standardization is the huge challenge. As Graham put, “Innovation is hard for the people who have to react to it.” It’s really hard to deviate from standards that brands have in place. While brands may want to jump into the deep end with online media, it’s difficult to take those chances on something that is so far removed from what they’re accustomed to. Some people who might benefit from innovation aren’t in a place to justify the changes.

So how does Facebook build this new set of standards? Investments. Facebook wants to invest in the people who can build new measurement platforms, and it’s not just about Facebook. They want cross-platform solutions for marketers to use to optimize and understand their consumers and online media. ”We do believe strongly in the platform; we believe strongly in the user side but also in the developer side,” said Sean. “The data is massive and there’s a lot of expectations around privacy, both user and marketer privacy. From a stability and access perspective we understand a lot, but we still need to hear from our users and marketers.”

While tough questions where asked, Graham says it’s not important to focus on why brands like GM pulled their Facebook advertising, but rather on the larger issue. Facebook believes it’s their responsibility to provide companies the insight and direction that actually has impact. Facebook isn’t the same as television and shouldn’t be approached with the same strategy. Whether or not that’s why GM pulled out, Facebook wouldn’t elaborate, but it’s a clear indication of the importance of measurement that companies at Big Boulder could potentially help to solve.

Facebook was tight lipped about product plans, but real time insights are important to FB. They want marketers to be able to see data as it happens. But there are challenges with this. From a measurement perspective, it’s not clear that marketers will even be able to take advantage of this data. As developers, Facebook wants to solve those problems too; how do we enable faster decision making through the tools they build? On a deeper level, Facebook wants to enable marketers to make decisions on a day-to-day basis, but it’s hard to have the level of intimate understanding of the data. If Facebook can get this feedback from it’s core marketers, they can better serve marketers and the end consumers.

Big Boulder is the world’s first social data conference. Follow along at #BigBoulder, on the blog under Big BoulderBig Boulder on Storify and on Gnip’s Facebook page.

Are Facebook Users More Optimistic than Twitter Users?

New Year’s Eve gives us a sense of closure on the past and an opportunity to make new dreams. With the emergence of social media, we can now see these reflections and resolutions transpire in realtime. As we observed the posts, comments, and tweets related to the New Year, we saw the typical expressions on Facebook and Twitter of best wishes for the coming year and pithy observations about the past year. What we didn’t expect was that users of the two popular social media sites would have different outlooks on the world.

As we enter 2012, Facebook users are more optimistic than Twitter users.

You’re probably wondering how we can say that. Well, we looked at all of the public posts on Facebook and Tweets on Twitter that contained “Happy New Year.” For all of those posts and Tweets, we compared the use of positive words such as “better” and “good” to the use of negative words such as “worse” and “bad.” We found that Tweets with positive words appeared 8 times more frequently than Tweets with negative words. You might be thinking a ratio of 8 to 1 is pretty optimistic…

It may be, but posts on Facebook had a ratio of 40 to 1–such a huge difference lead us to speculate that Facebook is a more optimistic place than Twitter.

Interesting stuff. Could be a variety of reasons for the difference, from the mix of users on each service to the fact that Facebook is used to communicate with friends, while Twitter is user to broadcast to followers. We’ll leave the speculation up to you.

Social Media Knows As Much About The Holidays As Santa Does

The holidays are an exciting time at Gnip…and not just because our CEO loves bringing random bottles of excellent Scotch to the office. Around this time of year we get some visibility into the incredible ways our retail and consumer product clients are using social data. In fact, Mashable recently highlighted a study by Mr. Youth (a marketing firm) with an incredible stat that helps prove how valuable social data in holiday shopping truly is:

“66% of respondents who bought something on Black Friday did so as a direct result of social media interactions with friends and family.”

While that stat speaks to the impact social media has upon us as individuals, think more broadly about how powerful it is to analyze that data in aggregate, in real-time. Companies are leveraging data from WordPress blogs, Twitter mentions, Facebook likes and multiple other sources to inform critical realtime decisions for inventory management and operational planning, sales and marketing planning, revenue forecasting, and many others.

Example Scenario for Using Social Data: It’s holiday time, 2011. Your company begins to aggregate ‘mentions’ of a new product from Twitter, Facebook, WordPress blogs in realtime. You take that data and analyze it for # of mentions about the new product, geography of posts (where available), demographic information within user profiles (what keywords are most consistent within Twitter user profiles that mentioned your product?), etc.

You spread that data among multiple divisions, providing additional forecast, regional buying pattern, and customer habit data. Your teams use that to:

  1. Manage supply chain: Redirect inventory to areas with highest potential sales and (depending on how far out you are) use as a data point in the S&OP system for manufacturing forecasts to keep ahead of the holiday demand.
  2. Target marketing spend: Use regional buying patterns and customer habit data to inform what demographic you are, and aren’t, hitting. Do you need to reposition your marketing plan?
  3. Incorporate product feedback: Are there consistent reasons why people are buying your product – or why they aren’t? Information on quality, packaging, price, etc will be incredibly valuable for future products.
  4. Calibrate investor expectations: Inform your IR team of potential positive/negative performance feedback to give them running room ahead of any announcements.

Those are just some of the more common use cases we’re seeing. But new opportunities are popping up on a daily basis. We spotted this gem in a recent WSJ article about finding a parking space during crazy shopping times:

Bud Kleppe, a real-estate agent in St. Paul, Minn., watches Mall of America’s Twitter feed for parking updates. (The mall sends them out under the hash tag #moaparking.)

Imagine collecting data from update systems like this and using it measure parking turnover across prime shopping days. Now, overlay the turnover of spots in specific sections against a map of stores and you have some interesting potential for data on economic performance and forecasting. When incorporated with other traditional retail data and compared on a store-to-store basis, you’ve built a unique and realtime analysis tool.

You’re only limited by your imagination in how you can apply social media data to you business. The more software developers, corporations, and people use social media, and the more things they use it for (like parking updates!), the greater the possible use cases for analysis of that data and the more valuable it becomes.

Gnip Cagefight #2: Pumpkin Pie vs. Pecan Pie

Thanksgiving is a time for family gatherings, turkey with all the delicious fixings, football, and let’s not forget, pie! If your family is anything like mine, multiple pie flavors are required to satisfy the differing palates and strong opinions. So we wondered, which pies are people discussing for the holiday? What better way to celebrate and answer that question than with a Gnip Cagefight.

Welcome to the Battle of the Pies!

For those of you that have been in a pie eating contest or had a pie in the face, you know this one will be a fight all the way down to the very last crumb. In one corner (well actually it is the Gnip Octagon so can you really have corners, oh well) we have The Traditionalist, pumpkin pie and in the opposite corner, The New Comer, pecan pie. Without further ado, Ladies and Gentleman, Let’s Get Ready to Rumble, wait wrong sport. Let’s Fight!

Six Social Media Sources, Two Words, One Winner . . . And the Winner Is . . .

 

 Source  Pumpkin Pie  Pecan Pie  Winning Ratio
Pumpkin Pie to Pecan Pie
Twitter X 4:1
Facebook X 5:1
Google+ X 6:1
Newsgator X 3:1
WordPress X 5:1
WordPress Comments X 2:1
Overall +6 Winner! +0 :(

 

We looked at one week’s worth of data across six of the top social media sources and determined that pumpkin pie “takes the cake” (so to speak) across every source.

In this case, it is interesting to point out that in sources like Twitter, Facebook, Google+ and WordPress we see higher winning ratios, while sources that tend to have higher latency such as Newsgator and WordPress Comments were a little more even. Is this because, on further consideration, pecan pie sounds pretty good? Or is it that everyone will have to have two pies and, with pecan as the traditional second, it is highly discussed?

Top Pie Recipes

Even though pumpkin pie was our clear winner, we thought it would be fun to share a few of the most popular holiday pie recipes by social media source:

  1. Twitter – Cook du Jour Gluten-Free Pumpkin Pie and Pecan Pie Video Recipe from joyofcooking.com
  2. Facebook – Ben Starr’s Pumpkin Bourbon Pecan Pie Recipe
  3. Newsgator – BlogHer’s Pumpkin Pecan Roulade with Orange Mascarpone Cream Pie Recipe
  4. WordPress and WordPress Comments – Chocolate Bourbon Pecan Pie from allrecipes.com

Non-Traditional Thanksgiving Pies

Another interesting fact that came out of this Cagefight was the counts of non-traditional Thanksgiving pies that were mentioned across the social media sources we surveyed. Though we rarely find these useful for communicating numerical values effectively, you can’t not have a pie chart in this post.

Happy Thanksgiving!

Delivering 30 Billion Social Media Activities Monthly . . . and Counting

I’m excited to announce that, as of the end of October, Gnip is delivering over 30 billion paid social media activities per month to our customers. This is the largest number of paid social media activities that have ever been distributed in a 30 day period.Over the past year, we’ve seen extraordinary growth in the number of paid social media activities we deliver. At the start of 2011, Gnip was delivering 300 million activities per month.  By May, that number was up to 3 billion activities per month.  And in October, we delivered 30 billion activities.  In essence, we’ve been growing by a factor of 10 every 5 months.  At this rate, we’ll be delivering 300 billion activities per month by March of next year

Cool numbers, but what’s driving this growth?

We’re seeing three key areas that are driving this number. First, we’re signing on new customers at an increasing rate, as more and more companies are seeing the possibilities in social media data. Second, we’re seeing increased interest in our Twitter firehose products. From hedge funds using social data to drive trading strategies to business intelligence companies layering social data onto their existing structured data sources, interest in volume products from Twitter is consistently increasing.  And finally, we’re seeing a marked increase in the number of customers using multiple sources to enrich their product capabilities.  From boards and forums to YouTube and Facebook, our customers are seeing the potential in the many other social data we offer.

So, 300 billion per month by March? It’s a big number, but the way things are going, I’ll take the over.

Google+ Now Available from Gnip

Gnip is excited to announce the addition of Google+ to its repertoire of social data sources. Built on top of the Google+ Search API, Gnip’s stream allows its customers to consume realtime social media data from Google’s fast-growing social networking service. Using Gnip’s stream, customers can poll Google+ for public posts and comments matching the terms and phrases relevant to their business and client needs.

Google+ is an emerging player in the social networking space that is a great pairing with the Twitter, Facebook, and other microblog content currently offered by Gnip. If you are looking for volume, Google+ quickly became the third largest social networking platform within a week of its public launch and some are projecting it to emerge as the world’s second largest social network within the next twelve months. Looking to consume content from social network influencers? Google+ is where they are! (even former Facebook President Sean Parker says so).

By working with Gnip along with a stream of Google+ data (and the availability of an abundance of other social data sources), you’ll have access to a normalized data format, unwound URLs, and data deduplication. Existing Gnip customers can seamlessly add Google+ to their Gnip Data Collectors (all you need is a Google API Key). New to Gnip? Let us help you design the right solution for your social data needs, contact sales@gnip.com.

Get your Hack On! Gnip Helps Power an App Developed at the 2011 TechCrunch Disrupt Hackathon

Over 500 individuals recently gathered in New York City for this year’s TechCrunch Disrupt Hackathon. This annual event, fueled by pizza, beer, and Red Bull, features teams of die-hard techies that spend 20 hours, many without sleep (hence the Red Bull), developing and coding the next big idea. Participants compete in a lightning round of pitches in front of a panel of judges with the winners receiving an opportunity to pitch on the main stage at the TechCrunch Disrupt Conference in front of more than 1,000 venture capitalists and industry insiders.

We are excited that one of the apps that was developed at the 2011 Hackathon was powered by Gnip data! We love it when our customers find new and creative ways to use the data we provide.

Edward Kim (@edwkim) and Eric Lubow (@elubow) from SimpleReach (@SimpleReach), which provides next generation social advertising for brands, put a team together to develop LinkCurrent, an app powered by Gnip data and designed to measure the current and future social value of a specific URL. When fully developed, the LinkCurrent app will provide the user with a realtime dashboard illustrating various measures of a URL’s worth — featuring an overall social score, statistics on the Klout Scores of people who have Tweeted the URL, how many times the URL has been Liked on Facebook and posted on Twitter, and geo-location information to provide insight into the content’s reach. Call it influence-scoring for web content.

The hackathon team also included Russ Bradberry (@devdazed) and Carlos Zendejas (@CLZen), also of SimpleReach, Jeff Boulet (@properslang) of EastMedia/Boxcar (@eastmedia/@boxcar), Ryan Witt (@onecreativenerd) of Opani (@TheOpanis), and Michael Nutt (@michaeln3) of Movable Ink (@movableink)– Congratulations to everyone who participated! You created an amazing app in less than 20 hours and developed a creative new use for Gnip data. I highly encourage all of you to check it out: www.linkcurrent.co

Have fun and creative way you have used data delivered by Gnip? We would love to hear about it and you could be featured in our next blog. Drop us an email or give us a call at 888.777.7405.

What Facebook Data is Available from Gnip's Social Media API?

Facebook is among the most in-demand (but also among the most challenging) social media sources to access. Most Facebook conversation data is private and so it’s not accessible via Facebook’s API or any of Gnip’s feeds. Facebook data availability is also pretty confusing to understand and the rules keep changing. So, let’s clarify what kinds of Facebook information we can offer through our social media API today. 

What Facebook Data is Available from Gnip?
Within the realm of publicly accessible data only, we provide:

  • User page content: status updates, wall posts, comments
  • Fan page content: wall posts, comments (probably more than you’ll find from any service), “Like” count, historical data up to 90 days


How Can You Get the Data?

Instead of a firehose of Facebook data, you enter parameters indicating what you want to find:

  • Keyword search
    You provide a list of keywords. We’ll return public mentions of those keywords.
  • Username search
    You provide a list of usernames. We’ll return publicly accessible posts generated by those users.
  • Fan page search
    You provide a list of fan pages. We’ll return publicly available posts and comments on those fan pages.

    While these lists are vastly simplified, we hope they’ll clarify what kinds of Facebook data most businesses can access legally, and exactly what Facebook data Gnip provides.

    Oh, and one last thing. We’re sometimes asked how we feel about Facebook’s privacy policies. At Gnip, we don’t make the rules — we just play by them. Our job is to facilitate access to the social data that publishers (like Facebook) officially make accessible to our customers.

    Best wishes to you with your Facebook data collection! If you think we might be able to help, please drop us a note.

    Our Poem for Mountain.rb

    Hello and Greetings, Our Ruby Dev Friends,
    Mountain.rb we were pleased to attend.

    Perhaps we did meet you! Perhaps we did not.
    We hope, either way, you’ll give our tools a shot.

    What do we do? Manage API feeds.
    We fight the rate limits, dedupe all those tweets.

    Need to know where those bit.ly’s point to?
    Want to choose polling or streaming, do you?

    We do those things, and on top of all that,
    We put all your results in just one format.

    You write only one parser for all of our feeds.
    (We’ve got over 100 to meet your needs.)

    The Facebook, The Twitter, The YouTube and More
    If mass data collection makes your head sore…

    Do not curse publishers, don’t make a fuss.
    Just go to the Internet and visit us.

    We’re not the best poets. Data’s more our thing.
    So when you face APIs… give us a ring.