|
Research
 |
White Papers
Towards an Ecological Theory of Sustainable Knowledge Networks
by Jeff Conklin, Clarence Ellis, Lynn Offermann, Steve
Poltrock, Albert Selvin, and Jonathan Grudin
Project Summary
Objectives and Methods
The primary objective is a theory of effective, sustainable,
geographically distributed teamwork. In an economy of large
national and global organizations and virtual enterprises, collaboration
among geographically distributed team members is essential.
Increasingly, people are able to work together across distances
by using technologies to collaborate in a shared virtual space.
They create artifacts while conversing about the artifacts and
the processes used to create them. Taken together, these artifacts
and conversations constitute a knowledge network that must sustain
the teams collaboration. However, virtual collaboration
is also very challenging. Too often, the technology of the knowledge
network becomes a hindrance, impeding the free flow of collective
intelligence and shared understanding.
The theory will be based on empirical studies of distributed
teams in the World Bank, Boeing, and Bell Atlantic. We will
observe teams at work, interview team members, and analyze both
their conversations and artifacts to determine the salient causal
factors in the long-term sustainability of distributed collaborations.
These observations are expected to yield a sort of ecological
theory consisting of principles that differentiate environments
that sustain teamwork from those that cripple it. Some aspects
of the theory will be tested in experiments conducted either
in the field or in a university laboratory.
A second objective is to capture the theory and its implications
in an online "Handbook." This Handbook will serve
as the research teams collaboratory, coordinating our
research processes and results. The Handbook will encourage
communication among researchers in this area and provide recommendations
to members of distributed teams.
A third objective is to develop a software-based "Collaboration
Assistant," based on the theory, that provides elements
of a sustainable collaboration environment. The Collaboration
Assistant will be conceptualized, designed, and implemented
using techniques of iterative team design and participatory
design. Pilot teams will use the Collaboration Assistant, providing
validation of the theory and its usefulness.
Potential Impact
Sweeping social changes are rapidly changing the demographics
of work, including the disaggregation of knowledge workers into
distributed and partially collocated teams. Currently, few resources
exist that can assist these distributed teams in improving the
quality and sustainability of their collaboration, such as diagnosing
and "healing" problems in their shared virtual space.
Achieving the objectives of this proposal will result in the
creation of both tools and theory that will provide support
for knowledge networks and avoid many of the pitfalls currently
experienced by distributed teams. If virtual teams become a
more reliable and productive way of conducting the business
of knowledge work, it could enable us to work more efficiently
and in more flexible, enjoyable ways.
Project Description
Section 1. Conceptual Framework
As the global economy heats up, there is more and more pressure
on knowledge workers to collaborate, to innovate, to make decisions,
and to do all of this faster than ever. At the same time, sweeping
social changes are disaggregating many knowledge workers, forcing
them to work together at a distance, with few opportunities
for face-to-face interaction. Telecommuting, multi-organization
projects, executives who are frequently on the road, branch
offices across a large organization or government agency, and
the use of remote consultants and scientific experts all conspire
to place new demands on teams of knowledge workers and on knowledge
networks.
While the telephone, fax machine, e-mail, and a host of other
technologies provide the necessary communication infrastructure
for these distributed workers, these technologies do not address
the specific obstacles of creative collaboration at a distance.
Creative collaboration involves the creation and sharing of
two kinds of information: the object being created itself, and
interactions about that object and the process of creating it.
These are the two aspects of "reflection in action"
(Schon, 1984), the duality of object and process (Robinson,
1991; Conklin, 1992). For collocated teams, creative collaboration
is challenging enough, but there are a host of conventional
tools and practices of face-to-face collaboration that provide
a literal shared space to support their work. For distributed
teams seeking virtual collaboration, however, technology must
provide a replacement for the literal shared space a
virtual collaborative space (Schrage, 1995) or common information
space (Bannon & Bødker, 1997; Schmidt & Bannon,
1992).
The most common and familiar kinds of virtual shared spaces
are on-line discussion databases, which are created around a
topic such as "Sailing" or "Italian Opera"
and in which a self-selected group of people hold an electronic
discussion by posting comments and responses. USENET newsgroups
and the PLATO project at University of Illinois, Champaign-Urbana
were early examples of this application, and now there are thousands
of such public discussions using a variety of technologies including
Lotus Notes and email listserve and shared folder systems.
These technologies have been put to use within organizations
for corporate projects ranging from community building and best
practices repositories to project-specific collaboration spaces.
For example, there are many case studies of organizational applications
of Lotus Notes discussion databases (e.g. Lloyd & Whitehead,
1996; Orlikowski, 1995 & 1992).
Discussion tools fall far short of supporting the collaborative
creation of complex evolving artifacts. Conversely, technologies
exist that allow groups to collectively add to and modify a
complex artifact, such as source control systems in software
engineering, but these systems dont generally offer significant
tools for communication about these artifacts and the process
of creating them. Ultimately, virtual collaboration environments
will need to provide tightly integrated support for both aspects
of creative collaboration. Moreover, robust knowledge networking
by virtual teams will require systems that allow knowledge workers
to move quickly and seamlessly between object-building activities
and discussions about the object and the process of building
it (Mark, Fuchs, & Sohlenkamp, 1997).
The challenge is much greater than integrating existing technologies
the current technologies provide inadequate support for
sustained distributed teamwork. For example, one member of our
project team was involved in a consulting contract to help a
client understand what was in their discussion database. The
client, a geographically distributed senior team in a large
bank, had been engaged for over a year in a Notes discussion
about how to deal with an upcoming merger. This database had
over a megabyte of threaded textual material concerning a variety
of issues. The senior team could no longer understand what was
in their database: what the group had learned, what the most
important issues were, or what they should do about the merger.
The consultants spent weeks analyzing the database, and in the
end were able to create a summary that illuminated several major
issues that were hidden in a fragmented and incoherent mass
of textual material.
This is not an isolated anecdote. We believe, based on direct
experience in this industry over the past decade, that for every
published case study of a successful virtual collaboration there
are many more unsuccessful attempts by virtual teams to use
CSCW and groupware tools. Of course, the reports of these failures
do not find public attention as readily as the successes, but
there is nevertheless a small but significant literature on
CSCW and groupware failures (Neilson 1997; Orlikowski, 1992;
Grudin, 1994 & 1990; Markus & Connolly, 1990; Star &
Ruhleder, 1996).
The lack of success may range from participant disappointment
and frustration with the tools and interactions to cancellation
of the project. As the size of the project team increases, and
the duration of the project extends in time, there is inevitably
a point where virtual collaboration spaces cost more
in human attention and energy, in time, and in frustration and
disorientation than the value they provide. Inevitably,
this leads to various forms of resistance and non-participation
(overt and covert) in the virtual dimension of the collaboration.
At this point, we can declare that the virtual collaboration
system has failed, irrespective of the ultimate success of the
project.
Our experiences with virtual project teams, and the literature
on the pitfalls and challenges of successful CSCW implementations,
suggest that many causes of failure stem from a poor ecological
fit between knowledge workers and the virtual environments they
try to inhabit. Knowledge networks need to be adapted to human
needs, preferences, and abilities (Turnage, 1990). They need
to be flexible enough to respect the cognitive, cultural, and
educational differences among the many participants in virtual
collaborations. In addition, they need to reflect a theoretical
understanding of the cognitive and social processes of creating,
developing, maintaining, and dismantling knowledge networks.
We propose here to assemble systematically the elements of an
ecological theory for knowledge networks, with a special emphasis
on issues of viability and long-term sustainability in the human/technology
ecosystem. This is an ambitious undertaking, but we believe
that the chances of success are good. This research team has
over 80 years of collective experience in research, design,
development, and deployment of CSCW systems. Significantly,
our experiences and studies have dealt with successful and unsuccessful
CSCW implementations. Others on the team have staked out new
territory in the field of virtual collaborations. Several members
of this team have strong international reputations in both academic
and commercial communities, and are known for their theoretical
contributions to science. Finally, we believe that we have designed
a research program, described below, which maximizes the likelihood
of far-reaching scientific discovery.
Why sustainability is crucial
The incredible success and growth of the Internet and World
Wide Web are a testament to the effectiveness of many aspects
of the modern communication infrastructure. Email, for example,
has evolved from an arcane engineering curiosity to a business
necessity within a few decades. However, most of the innovation
in communication and collaboration technology has been focused
on the "low hanging fruit", the little pieces of technology
that had large impacts and payoffs.
The remaining fruit, such as effective and sustainable knowledge
networking, is not so easy to reach. A few pieces of this higher
fruit may be readily "plucked" by new and emerging
products. However, when it comes to large complex projects,
such as the design of an entire modern passenger aircraft or
the development of an effective and appropriate loan to a developing
nation, no single technology will provide all of the elements
necessary for a diverse group of experts to maintain a rewarding
and sustainable virtual interaction.
In focusing on sustainability, we do not mean to imply that
knowledge networks should last forever, or that any pause in
growth implies an ecological problem. Virtual collaborations,
like face-to-face collaborations, have a natural rhythm and
pace to them; before they die they may go to sleep and even
go dormant for periods of time. The practical challenge for
knowledge networks is with illness and potentially early death
the failure of the ecology to sustain a virtual team
for its chartered or intended life span.
Among the many impediments to successful virtual collaboration
are broad issues of cognitive overload, lack of awareness of
others activities, lack of context about the purpose and
history of shared objects, lack of appropriate feedback and
acknowledgment of contributions to the shared space, disorientation,
unbalanced participation, divergence without convergence, and
problems with bringing new team members into a complex and established
collaborative space.
While each of these breakdowns could be studied individually,
this set of issues reflects the use of tools developed in the
absence of a practical theory, a theory that would cover the
cognitive, social and architectural issues concerning any sustainable
virtual environment.
First Steps Towards an Ecological Theory
Ecology is a good model for the kind of theory that would
be appropriate for this research. In place of hard laws the
field of ecology offers principles. It describes patterns of
interactions among diverse populations, sometimes competing,
sometimes cooperating, in a textured and changing environment.
It is a field that, while rich in quantitative methods, creates
theories about systems and wholes.
One possible ecological principle for sustainable virtual collaboration
is borrowed from economic theory. If the "net interaction
value" is defined as personal value less personal cost
of a virtual interaction, then a principle might be that the
more often an individuals net interaction value is negative,
the less likely that individual is to continue to participate
in the virtual collaboration.
Another principle might deal with "critical mass"
phenomena, e.g. the larger the proportion of relevant stakeholders
who participate in a virtual collaboration, the more likely
the collaboration will sustain itself (all else being equal).
A third principle of sustainability might describe the role
of mediation: there is a natural "information entropy"
which, over time, creates incoherence and cognitive overload
in collaborative spaces, and there is a complementary counter-entropic
force, usually but not necessarily human, which adds order and
coherence to these spaces.
An ecological theory of virtual sustainability will offer, in
addition to principles, specific "laws" or hypotheses
describing the dynamics of virtual collaborative environments.
Provisionally, these hypotheses fall into three broad categories:
factors relating to coordination and process, factors relating
to shared objects (e.g. context, usefulness), and factors relating
to orientation and cognitive overload in the collaborative space
itself. Here are some testable working hypotheses dealing with
these three factors, to provide a concrete example of the kind
of theory the research aims to create.
Hypotheses about coordination and process:
- One cause of unsustainability of knowledge networks is loss
of awareness or incomplete awareness of activities of others
in the system. Cues about what other people are doing are
important in helping individuals to orient in the collaborative
space and to pace their interactions. (Gutwin, Roseman, &
Greenberg, 1996; Gutwin & Greenberg, 1998; Mark, Fuchs,
& Sohlenkamp, 1997)
- Teams routinely create and share coordination objects, such
as action item lists, project timelines, and bug lists, to
sustain their interactions. Making these coordination objects
easier to share across distributed groups, both asynchronously
and as a resource in distributed meetings, contributes to
sustainability (Farkas & Poltrock, 1996; Sharples, 1993).
- An explicit representation of the team/project lifecycle,
assessment as to where you stand within it, and a guide showing
to how to move through it would help maintain process orientation
in a virtual project team. (The process of team formation
and evolution is complex. Leaders have tacit knowledge about
how to move a team through a process, and they access that
knowledge in face-to-face meetings. When in virtual collaborations,
they dont have that, e.g. they may not recognize that
they dont have alignment about team goals.)
- A teams processes are supported by creating shared
objects with affordances that guide team members to the next
step in the process. For example, a document ready for review
and approval may have editable sections for comment and signature
while the content of the document remains locked. The object
guides users to the appropriate tasks. Such objects engage
tacit knowledge and support teamwork more effectively than
explicit representations of the team processes.
- Individuals who receive little or no acknowledgment of or
responses to their contributions in a shared space will tend
to withdraw from participation in the on-line collaboration.
This becomes especially critical the more the groups
purpose is abstract or strategic knowledge work (as opposed
to group object-building activity).
- Greater levels of member participation and wider distribution
of participation (i.e., no one is dominating) will be associated
with higher levels of perceived user satisfaction with the
system and greater sustainability.
- Hypotheses about creating and using shared objects:
- People will only put attention/energy into a shared object,
and thus make effective use of it, if they have some sense
of its context: "Why am I looking at this? What am I
expected/allowed to do with it?" (Context includes who
and why and what next. Who covers author, intended audience,
and readers. Why could be answered by an annotation, or by
what else the object is linked to. What next addresses where
the object is in the flow.)
- Corollary to #7: How others have used objects in shared
space helps people orient to those objects. (Example scenario:
one is trying to make sense of a PowerPoint presentation that
has been placed ambiguously in the shared space; using Collaboration
Assistant one finds out that X used this presentation on Tuesday
to a management group as part of the pitch for Project Y and
there was a lot of interest and enthusiasm; this important
context makes one more likely to remember where it is and
to make effective use of that object later.)
- Sustainability will be a function of usefulness of shared
objects to the individuals in the system. (If most of the
information in the collaboration space is not personally relevant
or salient to an individual, it will take much higher levels
of extrinsic motivation to secure their creative input over
time; and, it is more likely that they will withdraw or that
their contributions will be suboptimal.)
- Hypotheses about orientation and cognitive overload:
- Individuals who get saturated or disoriented by information
spaces will tend to drop out; activities/services which reduce
cognitive load will increase sustained use of the shared space
(Conklin, 1987). (As formal and informal information accumulates
it becomes harder and harder to orient in the shared space,
and to know what the salient information is; this causes a
kind of cognitive overload that discourages people from participating
in the shared space.)
- Corollary to #10: New participants in the virtual collaboration
are especially susceptible to this kind of overload, and require
special kinds of summary and introduction to be "apprenticed
into" the virtual collaboration (Poltrock & Englebeck,
1998 & 1997).
- Corollary to #10: Mediation in a shared space (e.g. providing
summaries, archiving irrelevant or old information) can sharply
reduce cognitive overload.
- Systems that support different modes of interaction (e.g.
from independent to loosely coupled to tightly coupled) and
allow users to move easily among them will be more satisfying
to users and inherently more sustainable (Haake & Wilson,
1992; Streitz et al., 1992). (Systems that fragment activities
into different applications and media, with little or no sharing
among them, will be less sustainable.)
These hypotheses, if validated, have various implications. Some
suggest the need for mediation that would serve to prevent or
ameliorate factors that otherwise decrease sustainability (Okamura
et al, 1994) (mediation in this sense could be the role of a
human or the activities of a computer program such as the Collaboration
Assistant). Other hypotheses suggest features of virtual collaboration
systems that, if implemented, would make such systems more habitable
and collaborations in them more sustainable. Thus, the emerging
ecological theory has both social and architectural implications.
The goal of this research project is to use empirical studies
to develop this initial small set of tentative hypotheses into
a practical theory of knowledge network sustainability. This
theory will be expressed in the form of two deliverables: a
Handbook of virtual collaboration, and a computer program, a
Collaboration Assistant, which provides practical guidance to
virtual teams.
Section 2. Outline of the Work Plan
The primary deliverables from this research are a theoretical
framework, represented in published papers and project documentation,
as well as a computer program that embodies elements of the
theory and mediates virtual collaborations in knowledge networks.
The plan for this undertaking consists of five research activities
(each is described more fully in its own section below):
- Activity 1: Observations Observing and analyzing
existing on-line collaborative spaces and virtual teams (those
that have died as well as those that continue to survive)
for evidence of the causal factors of sustained collaborative
health.
- Activity 2: Handbook Building a theory and assembling
a Handbook consisting of the theory and principles, with qualifications
and examples. This will be a living document, accessible on
the WWW.
- Activity 3: Experiments Conducting controlled experiments
designed to test hypotheses like those listed above, and to
qualify and quantify specific parameters of essential sustainability
principles.
- Activity 4: CA a prototype software "Collaboration
Assistant" which implements the principles of the emerging
ecological theory, and which mediates potential problems in
the health of a collaborative space, sometimes automatically,
sometimes by advising a human mediator.
- Activity 5: Testing Evaluating and testing both the
theory and the Collaboration Assistant with real world distributed
teams who are using collaborative technology to solve live
problems.
Each of these activities has a leader and a primary center of
activity. These activities are not sequential Observations
and Handbook dominate the first year, Experiments and CA dominate
the second year, and Testing dominates the third year, but there
is also considerable overlap among them (see attached Project
Management Plan).
Section 3. Activity 1: Observing and analyzing
virtual collaborations
This activity will provide the empirical foundation for development
of an ecological theory. We will conduct a systematic examination
of organizationally-based virtual teams in their natural environments
to determine the key factors relating to sustainability and
productive functioning of their shared spaces. Where practical
we will focus on project teams engaged in a finite creative
collaboration, as opposed to operational or functional teams.
This research will extend and integrate ongoing studies at Boeing
(Poltrock & Engelbeck, 1998 & 1997), Bell Atlantic (Selvin,
1996), and the World Bank. The studies underway now at these
organizations are all concerned with support for effective distributed
or partially distributed teams, but they differ greatly in approach,
methodology, theoretical framework, and focus. This research
will establish a common framework and methodology that will
enable comparing results obtained in different organizations.
We will study how distributed and partially distributed teams
perform their work, focusing on factors relating to coordination
and process, factors relating to sharing objects, and factors
relating to orientation and cognitive overload. Generally, these
teams work together both synchronously and asynchronously, and
we will observe both kinds of interactions and attempt to understand
the role of synchronous interactions and how these could be
supported in an asynchronous collaboration environment. Factors
we plan to analyze for include:
- level of awareness of others participation in the
collaborative space (Hypothesis #1),
- level and accuracy of awareness of the status of the team
with respect to its milestones and lifecycle (#3),
- level of shared understanding among group members about
their respective roles in the project,
- individuals overall satisfaction in the collaboration
and their satisfaction with specific aspects of it,
- individuals sense of being heard and respected within
the group and its impact on their participation (#5),
- level and accuracy of awareness of the structure of the
shared space (#10),
- level of cognitive overload in the shared space (#10),
- ease of access to shared coordination objects (#2), and
- level of usefulness of the shared objects in the collaborative
space (#9).
Both qualitative and quantitative analyses will be employed
in this activity. Assessments will include: observation of teams
at work; examination of written team products; process, and
history (e.g., computer logs, e-mail, online discussions, product
iterations, stored materials); detailed participant interviews;
surveys examining both team process, attitudes toward the process
and people, perceived team success/failure; and organizational
or supervisor evaluations of the teams efforts. Team purpose
within the organization will also be examined as a potentially
relevant factor (e.g., software development teams vs. strategic
document production teams) as will potential individual differences
in functioning in virtual collaboration environments.
Data collection sites will include Bell Atlantic, Boeing, the
World Bank, and Corporate Memory Systems; letters of support
from appropriate organizational sponsors within these organizations
are attached.
A matched-pairs design will be used to select for assessment
pairs of teams within a given organization of the same team
type/purpose, where one is currently active and has functioned
successfully for at least one year, and another has failed to
meet expectations set for it (either disbanding prematurely,
prior to initial expectations, or continuing to exist, but with
limited productivity). In both cases, "success" of
the virtual team will be assessed based on evaluations of both
participants and supervisors. Teams expected to have an extended
life span (i.e., where sustainability is a vital factor) will
be selected. A matrix illustrating sampling and proposed comparisons
appears in Table 1.
The desired comparisons are:
- More Successful vs. Less Successful Virtual Teams (1 and
3 vs. 2 and 4)
Organizational Impact on Sustainability (1 and 2 vs. 3 and
4)
In addition, we plan to examine at least one database constructed
within a state-of-the-art hypertext collaboration environment.
The software project team which created this database over a
two year period made heavy use of several kinds of hypertext
links not available in other collaboration systems (Selvin,
1998 & 1996), and thus encountered different kinds of opportunities
and barriers than teams using more conventional systems (e.g.
email, Lotus Notes) would encounter. This analysis should
provide a revealing counterpoint to the other observational
sites. This work is being contributed by Bell Atlantic
see attached letter of intent.
These assessments are extremely time and labor intensive, but
are required to get a full picture of how these teams have made
use of the technology available to them, and how that technology
has supported or failed to support their efforts. Results of
these assessments will be analyzed with an eye toward further
developing and refining our hypotheses about virtual team success.
The observations and analysis from this activity serve as an
empirical foundation for all of the other activities; thus great
care will be taken to maximize the opportunities for these empirical
results to inform the Handbook, Experiments, and Collaboration
Assistant activities. In particular, analyses will reveal better
definitions of sustainability and optimal success criteria that
can be used in Experiments (Activity 3).
Section 4. Activity 2: Assembling a Handbook
of Knowledge Ecology
Overview. The research team will use the ongoing development
of an on-line Handbook as a way of coordinating the research
process and results during the entire three-year project, constituting
a "collaboratory" for the distributed research team.
This activity will include explicit theory building efforts,
in both electronic and annual face-to-face workshops, among
the research staff, building upon existing conceptual models
(e.g. Ellis & Wainer, 1994). The Handbook is also intended
as a vehicle for distributing the emerging theory to, and engaging
in on-line dialogue with, other researchers, partner organizations
(e.g. Boeing, World Bank, and Bell Atlantic), and the public.
Contents. The Handbook will contain many different kinds of
information, all interlinked:
- Methods and instruments used in Activity 1 (Observations)
and Activity 3 (Experiments);
- Issues, notes, ideas, questions, hypotheses, analyses, and
theories about the data in those activities;
- On-line discussions (both asynchronous and synchronous)
among the project researchers;
- Where appropriate, research reports and papers, both published
and in-preparation;
- Traditional handbook content, such as tips for virtual team
leaders, pitfalls of prolonged collaborations, and how to
facilitate asynchronous design sessions; and
- Information on the design, applications, and case studies
of the Collaboration Assistant.
Some materials in the Handbook will be "backstage"
information (Giddens, 1990), intended only for communication
and coordination among members of this research team. In particular,
it is important that researchers engaged in observational and
empirical studies (Observations and Experiments) connect frequently
with those working on the design of the Collaboration Assistant
(CA), and the Handbook will provide an important medium for
this cross-disciplinary collaboration. Other materials, in the
"frontstage," will contain information intended for
distribution beyond the research team.
In particular, the frontstage of the Handbook will be designed
for two audiences: people who are on virtual teams, and people
who are designing and developing virtual collaboration environments.
For example, if the empirical work supported Hypothesis #11,
the Handbook might suggest ways of orienting new project participants
to an existing knowledge network, such as having a senior member
of the project conduct an introductory tour of the space using
an application sharing tool. For developers, the Handbook might
recommend specific tools and practices that would facilitate
new users getting oriented quickly and with confidence. If the
hypothesis on the importance of acknowledgment is validated
(# 4), the Handbook might suggest a feature for electronic "nodding"
in the communication space; not necessarily agreement with the
"speaker," but simple acknowledgment that what he
or she said has been heard.
Media. The primary medium for the Handbook will be the WWW.
Some more polished aspects, such as principles for sustainable
virtual teams, will be publicly accessible. Connected to these
pages will be interactive spaces designed primarily for the
immediate "customers" of the research, such as employees
at Boeing, the World Bank, and Bell Atlantic, where they will
be able to ask questions about Handbook materials and provide
interactive feedback about their experiences using those materials.
By the second and third years, there will be other ways to distribute
and transfer the theory: published papers, a printed version
of the Handbook, training courses, pamphlets, tip sheets, and
so on, as appropriate.
Novel Aspects. One of the most intriguing aspects of the Handbook
activity is that its goal is to successfully create and maintain
a sustainable collaborative space for this research project.
As we identify potential principles of healthy virtual collaboration,
we will build them into the Handbook (to the extent that current
technology allows) and directly test them on ourselves. We plan
initially to construct the Handbook using Microsofts FrontPage®
and The Soft Bicycle Companys Consensus @nyWARE® systems.
As resources
allow we anticipate extending the Handbook using a variety of
other collaborative tools as well, to further our learning and
theory building. An additional benefit of using a virtual collaboratory
approach is that it will make it relatively easy to expand our
research team, to invite specific research colleagues to review
a theory, for example, or assist with the interpretation of
data.
Section 5. Activity 3: Conducting Empirical
Studies
Based on the results of the observations and analysis of the
virtual teams examined in Activity 1, Observations (p. *), systematic
hypotheses will be derived for empirical testing with experimental
or quasi-experimental designs. We expect that Activity 1 will
expand our provisional list of hypotheses beyond the empirical
scope of a single grant. Grounded, theoretically supportable
hypotheses around the three primary focus areas of sustainability
coordination and process, object sharing, and orientation
and cognitive overload will be given priority for testing
under this proposal. Ongoing organizational teams will be studied
when practical, with laboratory research examining basic underlying
processes, as well as to test underlying principles with greater
precision. Greatest attention will be given to hypotheses showing
greatest evidence of validity in Activity 1, Observations, and
those with the greatest potential for feeding useful information
into the design of the Collaboration Assistant.
These studies will involve better understanding the dysfunctionalities
of virtual teams, as uncovered in Activity 1, as well as putting
those in the context of the advantages face-to-face groups enjoy
that are problematic for virtual collaborators. For example,
recent work by Offermann and Eller (1998) suggests that face-to-face
decision making teams outperform computer-mediated teams both
in terms of decision quality and decision time. Yet some computer-mediated
groups performed as well as the face-to-face groups, indicating
that some virtual teams are able to overcome difficulties posed
by their communication medium. Understanding the specific reasons
for success and failure of computer-mediated teams, especially
as revealed and articulated within a shared space, will help
insure that more teams achieve success.
For example, our experiences with virtual teams strongly suggest
that the distribution of participation across the team may be
related to team functioning (Hypothesis #5). A study by Barry
and Stewart (1997) found that the proportion of extroverts in
a team related to team effectiveness, with either too many or
too few extroverts in a team being associated with poorer performance.
Practical experiences with collaborative spaces suggest that,
for some teams, participation dominance by a small proportion
of the team may be dysfunctional, and that a more even spread
of participation is preferable. These issues can be tested,
either by examining the existing distributions of personality
profiles in existing organizational teams in relation to their
participation, process, and output, and/or systematically varying
those compositions in laboratory-created teams. Consideration
of the social roles played by team members can also be considered
in projecting appropriate participation rates, with expertise
in a particular area of the groups mission escalating
expected inputs for a given person, and inexperience decreasing
it.
Social psychologists have long known that the distribution of
participation in groups is highly amenable to individual and
group feedback, with automated feedback able to completely reverse
initial levels of participation (Smith, 1972; Short et al.,
1976). Appropriate research on thresholds of participation differences
and the responses of members can lay the groundwork for the
development of Collaboration Assistant functionality that would
monitor individual member participation and give feedback as
to relative participation both to individuals (i.e., ones
own contributions vs. other members) or to the group or moderator.
Such systems could also perform a leadership role by encouraging
the involvement of more peripheral participants, or alerting
the leader/facilitator of the group that such action may be
appropriate.
Similar research on the potential advantages of programmed computer
assistance in managing overly large data resources, cueing facilitators
on the need for summarizing and focusing attention, or providing
succinct group histories and current project status that allow
new members to enter into the group more quickly are all reasonable.
In all of these respects, we propose that systems assistance
capacities can serve as "substitutes for leadership"
(Kerr & Jermier, 1978; Howell et al., 1990), and will endeavor
to demonstrate this through controlled experimentation.
|
 |