Late last week, several members of the Gnip team attended the 2011 Glue Conference, including Gnip’s very own CEO Jud Valeski, who delivered a keynote presentation on High-Volume, Realtime Data Stream Handling. Check out Audrey Watters’ article, Gnip CEO on the Challenges of Handling the Real-Time, Big Data Firehose on ReadWriteCloud, it does a great job of summing up Jud’s presentation.
We were thrilled to once again sponsor such an innovative and informative event dedicated to the bits and pieces, APIs and metadata, standards, and connectors that help “glue” together the applications of the web. We would like to congratulate Eric Norlin (@defrag) and team for putting on a great conference.
It was exciting to have seen several of our customers and partners at the conference, including ReportGrid, a realtime analytics startup, who used Gnip data to power their demo at the conference. For those of you that we met at the conference, it was a pleasure! For those of you that we missed, give us a call or shoot us an email, we would love to hear from you. See you next year at the 2012 Glue Conference!
This year’s Glue conference is right around the corner, and Gnip has a small spot that we’re going to use to discuss the emerging black market for data. Data providers, like Gnip, are under increasing pressure to provide their customers with “more data” than Publishers actually want them to have. Gnip has taken the moral high-ground position and complies with the terms of service that the Publishers we integrate with provide, yet we’re seeing more and more firms offer data that the Publishers explicitly disallow access to.
Our position is that we don’t want our customers building on a technical house of cards. While we can technically gather “more data,” doing so in a manner that violates the ToS of a given Publisher ultimately leads to an adversarial relationship between us and said Publisher. As a result, we’d be putting our own customers at risk when that scenario goes south (and it eventually would). The result is a widening gap between legitimate, and illegitimate data collection. This should signal high-demand Publishers to mature and build real solutions that market dynamics clearly require.
I don’t have my thoughts fully formed on this topic, but it should make for a good discussion at Glue! Hope to see you there!