Deciphering the Human Script: What Jazz Repository Communications Reveal About Team Behavior

What affects team behavior? Preliminary linguistic analysis of communications in the Jazz repository

2012-06-01
Sherlock A. Licorish, Stephen G. MacDonell
Summary
Problem
Method
Results
Takeaways
Abstract

This paper presents a preliminary linguistic analysis of software development team behaviors by mining the IBM Rational Jazz repository. Using the Linguistic Inquiry Word Count (LIWC) tool, the study examines practitioner communications across different project types—User Experience, Project Management, and Code—to determine how the project environment affects team interaction dynamics.

TL;DR

Is the way developers talk influenced by the type of code they write, or are team behaviors universal? By analyzing over 117,000 messages from the IBM Rational Jazz repository using linguistic tools, researchers Sherlock Licorish and Stephen MacDonell discovered that software team behaviors are surprisingly consistent. Regardless of whether a team is building UI or managing projects, their linguistic "fingerprint"—marked by high task-focus and low negative emotion—remains remarkably stable.

Background: Beyond Code and Tools

For decades, the software engineering industry has obsessed over "The Next Big Tool" or "The Perfect Methodology" to solve project failures. However, a growing school of thought suggests that the human element is the true bottleneck.

The authors of this study argue that to understand teams, we shouldn't just ask them how they feel (which is intrusive and biased); instead, we should look at what they leave behind: their communication artifacts.

Methodology: High-Throughput Linguistic Mining

The researchers leveraged the IBM Rational Jazz environment—a platform where project management and development happen in one place. They focused on three diverse project areas:

  1. P1 (User Experience): Design-focused tasks.
  2. P2 (Project Management): Coordination-heavy tasks.
  3. P3 (Code/Functionality): Core development and middleware tasks.

To analyze the data, they used LIWC (Linguistic Inquiry Word Count), a gold-standard psychometric tool that categorizes words into psychological dimensions like "Cognitive Processes," "Social Words," and "Affective Processes."

Project Summary Table Table 1: The scale of the analyzed project areas within the Jazz repository.

Key Insights: Does Context Matter?

The central research question was: Does the project environment affect team behavior?

1. The "Stability" Surprises

The researchers initially expected that experts in a distributed, high-stakes environment like IBM would show high levels of "Collective" language (using "we" instead of "I"). Surprisingly, they found:

  • Low Collective Language: Team members used more individualistic language than collective, likely because tasks like bug fixing are assigned to individuals.
  • Universal Positivity: All teams maintained very low levels of negative emotion (under 5%), suggesting a professional, highly-controlled communication culture.

2. Cognitive vs. Social Traits

While developers are often viewed as "high-cognitive" individuals, the linguistic data showed that "Insight" and "Certainty" language terms were not as dominant as expected. Instead, Social and Work-Achievement language was much more prevalent, reflecting the high pressure to deliver.

Team Behavior Model Figure 3: Proposed model illustrating the convergence of factors affecting Jazz team behaviors.

3. Chronological Evolution

By dividing the projects into four phases, the authors observed how teams "mature":

  • Phase 1: High social language as members form relationships.
  • Final Phases: A surge in "Work" and "Achievement" language as delivery deadlines approach.
  • Maturation: Individualistic language ("I/me") consistently decreased as projects progressed, showing that teams naturally become more synchronized over time.

Linguistic Measures Across Phases Figure 2: Tracking the pulse of teams—Work, Achievement, and Social language fluctuations over time.

Critical Analysis: The Professional Veneer

One fascinating takeaway is the discrepancy between project types. The User Experience (P1) team used significantly more "Positive Emotion" words. Is this because they are happier, or because their domain—design—naturally involves more subjective, "friendly" feedback like "This interface looks nice"?

Limitations:

  • The "Jazz" Bubble: The results are specific to IBM Rational's professional culture. Open-source projects (like those on GitHub) might show far more polarized emotions.
  • Tool Sensitivity: The LIWC tool might not capture specialized technical jargon (slang/code snippets) that developers use to express complex thoughts.

Final Takeaway for Managers

This research suggests that team behavior is an invariant. You cannot change the "social soul" of a team simply by switching them from a front-end project to a back-end project. Instead, project success depends on managing the universal evolution of a team from an individualistic starting point to a collective, achievement-oriented finish.

If you are leading a software team, don't just monitor the code; monitor the connotations of their discourse.

Find Similar Papers

Try Our Examples

  • Search for recent studies that utilize LIWC or similar sentiment analysis tools to predict software bug density or developer productivity in GitHub repositories.
  • Which paper first established the link between "first-person plural pronouns" (we) and team cohesion in collaborative environments, and how does this paper build upon that theory?
  • Explore how linguistic analysis of developer communications has been applied to identify "burnout" or "toxicity" in Open Source Software (OSS) communities compared to corporate environments like IBM Jazz.
Contents
Deciphering the Human Script: What Jazz Repository Communications Reveal About Team Behavior
1. TL;DR
2. Background: Beyond Code and Tools
3. Methodology: High-Throughput Linguistic Mining
4. Key Insights: Does Context Matter?
4.1. 1. The "Stability" Surprises
4.2. 2. Cognitive vs. Social Traits
4.3. 3. Chronological Evolution
5. Critical Analysis: The Professional Veneer
6. Final Takeaway for Managers