Social media listening tools today simply do not accurately report author location, even though they often say they do. Here’s why.
When you look at your social media dashboard — or listening tool, or river of news — most of the data you see in your tool was gathered or created in one of the two following ways:
But location data is different. In most tools, the physical location of the author is actually determined through a hybrid of the above approaches, as follows:
- Website registration information: The tool might determine the location where the site is registered through a reverse lookup of the site’s registration information. Such an approach is not reliable when the property is registered to one entity and authored by another — or authored by several others, in the case of a group blog. Further, the vast majority of social media conversations occur within social networking domains and platforms, rather than on blogs registered to individual users.
- Top-level domain: The domain “extension” that can indicate the country of registration, for example: “.ca” in Canada. First, many of the flaws in the above bullet also apply to this technique. In addition, a forum is hosted on a Canadian domain certainly will not restrict participation to Canadians only; even if they did, there is a vast difference between an author in Quebec and author in the northern reaches of the Yukon Territory.
As a result, automated author location analysis is not very reliable.
As more companies rely on listening tools for business decisions, it’s vital that we all understand the true quality and level of reliability of the data in our monitoring tools. The simple reality is that most people assume that the data in their listening tool is reliable, and that’s simply not always the case — especially for author location data.
While location-based services like Foursquare and Gowalla can provide reliable author location data, and Twitter enabled geo-location reporting months ago, very few people use such those services. In fact, less than 1% of all Twitter users report their location when tweeting, and Pew recently reported that only 4% of online adults use any location-based service. Further, those users who use location-based services submit a small portion of their social content with location data attached.
For now, we should all place very little faith in the geographic data within automated tools until self-reported geo-location becomes more prevalent. In fact, we suggest that all of our clients do the following when considering the use of author location data in social media analytics and reporting:
- Only rely on geographic data that is (a) self-reported or (b) verified by a human analyst.
- Ask your listening provider how their tool determines author location, and the extent to which the information is truly reliable.