Showing posts with label survey. Show all posts
Showing posts with label survey. Show all posts

Nov 6, 2010

Preeliminary survey results of ICT use by social movements worldwide - snippet

So I am in the depths of analysis, but here's a short set of interesting numbers I just compiled. I was looking at member age ranges by sampling frame, here's the percentage of organizations with young membership (18-30 as percentage of total number of organizations in that frame...

ALL    21.84%
PITTSBURGH-BASED    14.29%
GLOBAL   16.34%
POLAND-BASED    26.43%
INNOVATIVE*   37.04%

*INNOVATIVE - my snowballing sampling scheme, based on surveying the movements/organizations whose webpages revealed significant Web 2.0 knowledge.



It appears that innovative organizations have the youngest membership; followed by Polish in the middle, and at the other end, we have the global/Pittsburgh organizations.

Now, here are the same stats for the oldest membership (over 50):

ALL    11.21%
PITT    10.71%
GLOB    16.99%
PL    5.71%
IN    7.41%

Global organizations have the older membership, but Polish ones are again an interesting outlier, having an even smaller number of old-membership organizations than the Innovative group. I wonder if this is because older generation in Poland has no tradition of activism?

So, as expected, we can talk about young members using new tools more often, but the Polish data does make for another interesting and unexpected story

I am now compiling the data, expect more in the coming months. I hope to be able to give you full analysis coming Spring.

Apr 22, 2010

Preeliminary survey results of ICT use by social movements worldwide

The first results of my global survey are here. So, what are the numbers? See them on Google Docs.

Those are very early results, and I am hoping to increase the response rate significantly (as in: from ~5% to at least 15-30%). A more international response would be nice, too, although it is inevitable that a Western/English bias will appear (English hegemony of the Internet, etc.).

The results linked above combine results from my local and current global survey, for a net total of 62 responses. For results from the first, local survey (Pittsburgh, PA, USA) only, see here.

Once I get enough responses from the global survey, I will post another update here.

The survey is still ongoing (and likely will be for a few more months). If you would like to take it, and did not receive an @ from me with the invitation to it, you can use this generic link to access the survey.

Aug 25, 2009

Preeliminary survey results of ICT use by social movements in Pittsburgh - update

A month ago I released the preliminary results with ~10% response rate and promised that I'll release new results when we cross magical numbers of ~20% and (target) ~30%. Now we are midway at ~20% and hence I'd like to update you the new insights gained from the survey.

Before I go into the numbers, first, an interesting observation that comes from some interviews / phone conversations I recently had with some of the respondents. Many do not consider their organization a part of a "social movement" - yet at the same time they are happy to be listed as a group for "social justice and change" on TMC website. This shows that there is an interesting difference between academic (ivory tower...) definition of what a social movement is, and what an average person (activist...) thinks of it. Plus, from the academic perspective, there is the problem of blurry boundaries - some organizations may be seen as not part of the movement itself, but rather, of the allied "movement community", which can be best understood as the attitude "we are not activists, but we broadly support them". And since in real life it is often difficult to distinguish where the movement stops and the community begins, it is understandable that my survey will reach both spectrums - which I think is fine, as community organizations are no less important (if less showcased) than the movement ones. So if you are not sure if your organization is part of the movement, you can rest assured that as long as you are fine with being listed on TMC list, you are part of the larger community that I am interested in :)

Now, back to business. With the response rate doubling, what has changed?
* a few newer organizations have replied (out of 19 respondents, 3 are in the "our organization is 2 years or younger group", and 16 are in "our organization is 5 years or older group")
* as for areas of focus, environment (9 respondents), health (7) and community and social services (7) are still among the most popular, but have been joined by education (7) and human rights (7).
* so what's unimportant? Culture (4), intellectual property / free culture (6), Internet / network neutrality / digital divide (6) and religion (4) were all selected but ranked only in the third tier ("Least important" - but still important enough to be ranked as third), and
economy / promoting business / labor / trade and commerce (6) is in the middle tier
* ~75% of organizations indicate they have non-members (supporters) who participate in their organization activities, about half have non-members who recruit others for the organization
* at this point, for every new innovative technology I suggest (from blogs through video-sharing sites, wikis to Twitter) there are respondents who indicate their organization finds it useful for something.

For the results to be considered reliable for academic research, a responce ratio of 30% is needed (which translates in ~10 more people taking the survey). Hopefully, in about a month, I'll be able to report that the local survey is done, and move on to my second stage - the international survey.

It is my hope that once the results are fully analyzed, you'll be able to look at what your peers are doing, and thus find some helpful solutions and strategies to benefit your organization.

Thanks to all that took the survey, and to those that will take it - a few minutes of your time greatly contributes to our understanding of how organizations desiring social change are using the tools of the Digital Age.

Jul 22, 2009

Preeliminary survey results of ICT use by social movements in Pittsburgh

I am a strong believer that science is for the people, not to be locked in ivory towers. Hence, over the coming months I will be publishing a series of blogs documenting research progress in my PhD dissertation, which, roughly, aims to survey and analyze how social movements are using new information and communication tools (think new media - blogs, twitter, wikis, etc.). This analysis should also show the wider public why such research is actually useful :)

To this date, while individual use of some of those tools in organizations was studied, nobody has tried to do a comprehensive analysis of how Internet-era ICT are affecting the social movements. This seems to be to be a major omission on the part of social movement researchers, and I believe that deeper understanding of this issue will be of much use both to the scholars, and to the movement activists themselves.

The first stage of my research involves surveying movements local to my region, which is Pittsburgh. Later stages should provide data on national and international levels.

The Pittsburgh survey takes advantage of the existence of a local social movement coordination organization, the Thomas Merton Center. A downside to this is that TMC has a left wing bias, and thus this survey is likely missing some right wing movements. This should not be an issue with the latter surveys, which will be based on more neutral sampling schemes. TMC list of "justice groups" has approximately 200 entries (193 to be exact), out of which, 125 seem to have or had online presence (i.e. I was able to find their contact info in form of an email (112) or web-based contact form (13)). I should note here that the TMC list has online contact info only for ~15% of the movements, the other 50% I googled myself.

This yields the first interesting statistic: in Pittsburgh region, we can say ~65% of movements have online presence. In other words, a decade into the 21st century, ~35% of local movements have never entered the Internet - an interesting comment on a digital divide, and a contradiction to an existing statistic by Surman (2001) who estimated, nearly a decade ago, that in the developed world, ~90% of voluntary organizations have internet presence. I am already wondering what will be the findings of my larger scale surveys.

Out of 125 online contact addresses, 2 have opted out before from being ever contact for future surveys (according to surveymonkey - the tool I use - database), and 21 have bounced, which indicates to me that that movement is no longer active. Thus the real sample size is 102. Out of those, I have gotten, two weeks and two mailings into the survey, 11 replies (10.7% response rate).

Here I want to heartily thank all the people who have taken time to complete the survey so far, and I should note that the survey is still open (and will be for several weeks), so if you would like to improve our understanding of the ICTs in movements in Pittsburgh, please consider taking the survey :) (please use a personalized email invitation link instead of this one if I have got a survey invitation from me before)

Now, onto the preliminary results. 11 is a relatively low respononse rate, and this does impact the validity of the results somewhat (just a few more responses would do wonders here). If and when I get more responses, I will post an updated analysis. Still, with 11 responses there is enough data to see some interesting patterns. I am bolding those that I found most surprising/interesting:

* all surveyed movements concentrate on local or regional issues
* 80% of surveyed movements are 20 or more years old, all are 5 or more years old
* more responses are need to reliably judge areas of interest, currently, environment, health and social services are the leading areas, but I think this may change if and when more movements reply to my survey
* most movement who replied have few hundreds members
* on average, organizations which replied have ~16 computes connected to the Internet
** Those two may indicate that primarily representatives of larger movements have responded to my survey so far... although it's hard to be sure, as there is no data on size of local movements (maybe most or nearly all movements are that large? Yet somehow I have my doubts here)
* all movements indicate that they have non-members (supporters) who participate in their organization activities, about half have non-members who recruit others for the organization
* member's age distribution seems to be concentrated in the 31-50 range
* majority of respondents think that Internet is very important to the organization (~60% declared it is very important, ~30% as important, only ~10% (=1...) as very unimportant

The second part of the survey, due to its matrix build, needs more replies to be valid; still, here are current highlights:
* face to face communication seems to be the single most important when it comes to management, recruitment, and fund raising, but ICTs become more important when it comes to interacting with other organizations. Usage of traditional mail, websites and emails is popular as well, but there a minority (10-20% = 1-2) of respondents indicate that their movements use new innovative technologies (blogs, internet foras, social tagging, social networking, Twitter, etc.).
* about half of the respondents agree that younger members are much more likely to use the Internet; only 15% disagree
* Internet seems to be used equally by all members, no matter what their rank in the organization
* Usage of tools is dependent on their recentness, more or less as we would expect, although interestingly, texting is used by three organizations - but only in since about a year
* There is strong correlation between ICTs - whether pre-Internet or post-Internet - and a feeling that they give both the individual and the organization more of a say. I would like to say that the the new ICTs are slightly more correlated with that then the old ones, but validity is really an issue here (more replies are needed for me to be able to discuss that)
* there seems to be a general interest in the ICTs, and several respondents indicated that their organization may use the newer, more innovative ones in the future
* at least two of the surveyed organizations are familiar with and are using wikis

That's it for the preeliminary analysis. Once again, I'd like to thank all who have taken (and will take...) their time to fill the survey. If you have not done so, I hope that the analysis above does show how valuable even one answer can be.

I will make a new update when the survey closes with more than 20 respondents, or as soon as that number is reached (and I will make further updates for each 10 more respondents). In theory, past studies suggest I should eventually get about 30 responses, since online survey response rate is about 30%. I will let you know if this holds true in my case :)

PS. The full dataset, minus any potentially confidential information (like emails and such) will be make available online once the survey is completed. Science is for the people...

Jul 16, 2009

Where Wikipedia doesn't work

I have to wonder why Wikipedia community has so much trouble researching itself. Sure, we love to talk about ourselves - we have blogs, newspapers (Signpost), podcasts... but when it comes to serious research, the initatives fail one after another.

Wikidemia, Wikipediology, Wikimedia Research Network - all dead. Even the Wikipedia in academic studies is doing poorly if I am not there to update it - you'd think that increasingly more numerous scholars studying Wikipedia would at the very least bother to advertise their work - apparently not :(

It took us years to get a side wide survey in 2008 - and even it had to be done by outside scholars, with all the transparency and communication problems that implies (there were some rumors about making data set publicly available, but if there has been any confirmation, I am unable to find it). The community survey project, the General User Survey, was never consulted, and there are no signs that we will have a 2009 (or 2010) survey.

There are signs of hope. The usability project looks promising. The Foundation has recently hired a Research Analyst. Yet...

My general impression of this is CHAOS. Things are being done on many foras. There is the usability project, there is the Wiki-research-l listerv, there is Wikidemia, there is the Wikimedia Research Network, things are annouced in Foundation blog or via press releases, there are initatives of individual non-English chapters (for example, non-English surveys of users...).

Some time ago I tried categorizing research pages on Wikipedia and on meta, but it's a loosing fight, particularly since there is no central place to announce them (research is being done and discussed everywhere possible, from Wikipedia subuserpages to people's own blogs). There is little to communication between existing foras, which have different members are differ in openness and focus, old foras are being abandoned due to little activity, new ones are founded by people who don't know about the old ones, research efforts are likely duplicated in various places, and the cycle goes on... it's a chaos, and pretty messy one at that :(

I hope that the new Research Analyst (whoever s/he is) will start by bringing an order to this, and creating some central forum for all of those initiatives, preferably based on a wiki somewhere.

PS. If you know of Wikipedia research initiatives / foras I missed, do let me know. I wonder how big is the iceberg that I a tip of I am ranting about :)

May 15, 2009

Help pretest my survey

A crucial part of my PhD thesis is a survey for movement activists about their usage of communication tools. A crucial part of that is that the survey must be as clear and as short as possible. Here's where I need help: I need a few kind souls to read through the survey (link), and to note any parts that are confusing, contain errors (I am not a native English speaker...), and let me know how long did it take you to complete the survey (I hope that it is doable in ~20 minutes).

You can reach me by commenting here, at my Wikipedia talk page, at Facebook, or at piokon at post dot pl. Thanks,
 
Listed on BlogShares Creative Commons License
Voice of the Prokonsul by Piotr Konieczny is licensed under a Creative Commons Attribution 3.0 United States License.
.