Enterprise 2.0 : Harmonising formal processes and ad-hoc work
In the previous post I reviewed a video interview with the talented Jordan Frank from Traction Software, which was on social tools and ad-hoc processes. This video got me inquiring further into what others have said about this over the past couple of years. So I headed to my bookmark collection, and this post is what resulted.
But first I’ll repeat a few highlights from Jordan’s interview:
- Workflow systems are great until they fail…a need to have a collaboration safety net.
- Collaboration is not necessarily about making the things that are planned go right, it’s about dealing with the things that are unplanned that go wrong
- It’s hard to troubleshoot when what happened till now is not easily accessible or not recorded in a raw fashion
- You can’t anticipate a workflow for fixing a problem (with social tools like Teampage) you can model informal processes on the fly
- Make sure when business conditions change your business processes don’t get left behind
I also linked to one of Traction whitepaper’s that demonstrates the bottom-up enabling tools we now have to better cope with getting things done, and by default achieving the original aims of KM and being an agile organisation.
Emergence by default
Social computing is about many things: discovery, connection, conversation, emergence, crowdsourcing, transparency, engagement, innovation, collaboration, findability, diversity, sharing, learning, helping, sense-making…
Helping and sense-making have an immediate impact eg. stuck on an issue, asking a question, getting an answer and moving on…whilst this happened others got to learn for free.
In a way emergence happens anyway as a result of sense-making ie. emergence that surfaces from "In-the-flow" working, which is in contrast to "Above-the-flow" emergence (crowdsourcing, sharing your experience, etc). Either way we have emergence because people are visible and their interactions are documented, all made possible via bottom-up enabling tools.
Another immediate sense-making aspect is dealing with exceptions to processes. Email is our survival tool to not only improvise, but to plain and simply do work. Same goes with MS Word and Excel…then put them together as email and attachments.
James Dellow pins this down:
|
"Like cockroaches, spreadsheets have continued to thrive despite the growing (perceived) sophistication of modern enterprise information system. They record data, drive barely repeatable processes, they are spread around by email systems and people use them to address problems that other systems fail to solve." |
Process vs Practice
I will refer later to "barely repeatable processes", but for now let’s looks at processes and how we need flexibility.
Jack Vinson quotes Mike Gotta on Process vs Practice:
|
"Process is "how work should be done." And Practice is "how work is actually done." When process fails (exceptions), people use practice to fix things. When process doesn’t exist, practice fills the void. While people don’t realize it when they engage in practice, they actually are tapping into community — an informal social network within or beyond the enterprise to discover expertise and get things done. The problem is that we haven’t had the tools to support good practice." |
An interesting comment on Jacks post by Marnix:
|
"Process is the way work is being done, combining technology and practices. Culture is when this happens unconsciously; ’it is just the way we do things around here’" |
Move from pre-defined structure to DIY
Bil Ives says the difference with new social tools is that the people (users) decide on the structure of the process:
|
"ERP provides infrastructure that often requires work processes to confound to the software structure. Enterprise 2.0 is often attempting to provide tools that will conform to your work practices. With ERP adoption is not the issue, except in the 9% of cases where parallel adoption is used, With ERP the issue is implementation, as people are generally required to use the system. The study stated than 83% of the ERP implementations studied were considered successful." |
Bill also says:
|
"The irony of enterprise 2.0 is that you actually get more control because the free form nature of the tools allow the business people to decide on where structure occurs, not the people who make the software.” |
Joe McKendrick gives BPM a new name:
|
"No matter how automated a workflow may get, there are always stages in which things need to stop for an exception, an approval or a quality check. The role of human interactions has always been a complicating factor in business processes. Introducing Enterprise 2.0 approaches may help shift the emphasis from business process re-engineering to business process re-energizing." |
Jim McGee combines the concept of rigid processes and how it relates to emergence:
|
"In an accounting or ERP system, the system’s designers specify all aspects of workflow, database design, and information structure in advance. Users are expected to select from among pre-defined choices and enter only such data as the designers have provided for. In designing a system for emergence, the designers leave a number of these decisions open; waiting for users to fill in the blanks" |
Paula Thornton comments on a past post of mine on this meme:
|
"Real knowledge work is about handling the exceptions. Everything else can be automated. Thinking about the frustrations you’ve had with anything you’ve tried to accomplish in getting work done (save your own shortcomings or those of others). A good majority of them are either due to over-automation (not allowing for exceptions) or underautomation (leaving you to manage mundane tasks). What IT methodology focuses on assessing for such balances? NONE!" |
These are our tools to execute work. They are also the tools that come in especially handy when the process system we should be using is too rigid.
I know when I was doing document management support work the support database was merely used as managing the call, but the conversations happened in email. That is, email is our coping mechanism. I’ve posted on this before, and Larry Hawes has a post on the hybrid use of both process-centric and people-centric tools. The BPM type tool to locate issues, status, who’s on it, blended together with conversational tools where the troubleshooting actually happens. There is a place for both where they complement each other…the road ahead is integration 2.0.
This is when we say social computing isn’t really anything new, it’s just the next survival tool or coping mechanism which is more effective than email. Especially in circumstances where we need help, and ad-hoc collaboration to get through a process. We have phone, then email / IM and MS Office, now we have microblogging, blogs, forums…and wikis to stitch the process together.
Even a janitor is not absent from these non-routine and improvisational working conditions.
Unstructured and Barely Repeatable Processes
Sandy Kemsley notes that Gartner calls this unstructured processes:
|
“…work activities that are complex, nonroutine processes, predominantly executed by an individual or group highly dependent on the interpretation and judgment of the humans doing the work for their successful completion”and notes that most business processes are made up of both structured and unstructured processes. Unstructured processes are costing organizations a lot of money in lost productivity, lack of compliance and other factors, and you can’t afford to ignore them. Although most processes aimed to meet regulatory requirements are structured, unstructured processes provide a company’s unique identity and often its competitive differentiation, as well as supporting operational activities." |
Sandy moves the conversation to Integration 2.0, where social tools are features of existing business process tools
|
"…the BPMS vendors are looking for ways to incorporate “barely repeatable processes” into their systems, allowing users to create their own ad hoc processes on the fly but still capturing the audit trail so that it’s not just happening over email or the phone in an unaudited fashion. The idea is not to pre-define all of these processes, but to provide tools that allow process participants to have a sufficiently unstructured environment to do what they need to do, and augment that process with their own call-out at that point." |
I have posted before on Barely Repeatable Processes, and Exception Handling and am going to re-quote here from some of the pioneers in this movement.
Ross Dawson explains the need to complement an ERP - Easily Repeatable Process, with a BRP - Barely Repeatable Process (via Sigurd Rinde):
|
“Typically exceptions to the ERPs, anything that involves people in non-rigid flows through education, health, support, government, consulting or the daily unplanned issues that happens in every organisation. The activities that employees spend most of their time on every day. Processes that often starts with an e-mail or a call. A process volume, measured by time and resource spent at organisations, probably larger than for the Easily Repeatable Processes. These are mostly handled and organised - frameworked - by systems like paper based rules and policies, e-mail, meetings, calls and now in more modern organisations by wikis and other collaboration systems and methods. Known by extensive loss of information (e-mails residing on HDDs), little knowledge acquired and reused (typical research says 70% of problems solved before without being known) and most of all, untrustworthy processes (oops, forgot to send that mail). In other words not an iota (well almost) of business process thinking or methodology applied to this huge untapped area of business processes.” |
Ross Mayfield on the same meme:
|
“The way organizations adapt, survive and be productive is through the social interaction that happens outside the lines that we draw by hierarchy, process and organizational structure. The first form of social software to really take off to facilitate these discussions was email. Most employees don’t spend their time executing business process. That’s a myth. They spend most of their time handling exceptions to business process. That’s what they’re doing in their [e-mail] inbox for four hours a day. Email has become the great exception handler.” |
Bottom-up structuring of ad-hoc processes
Before I spoke of using social tools to sense-make (get help, get through a process), well the next step are apps created from the bottom-up (by the users), that have noticed how people use social tools in an ad-hoc way, and are offering a way to design or assemble this process into a more visible flow. Basically making your own process, which you can manipulate at any time to suit the situation.
A way to see it is a kind of semi-formal approach where you are agile enough to assemble an app to slightly structure ad-hoc work:
Dennis Howlet talks about Thingamy software:
|
"…‘barely repeatable processes’ - a good way to look at them - where you need a quickly built app that includes the process loops in order to solve the problem." |
And Jacob Ukelson talks about ActionBase:
|
"One thing to be careful with is that you want to provide enough structure to the process to add value, but not so much as to strangle it. Given that most of these processes are executed today via documents and email, we built our tool as an extension to those standard office tools - allowing the same ad-hoc feel, but adding a layer of management, tracking and reporting. "For many of these processes an initial formal model is overkill (and at odds with the needs of most knowledge workers) - at most you want a guideline or best practice that gets modified as the work gets done. Then these emerging models can later be used to create a more formal model if needed (I’ve blogged on the topic of in-situ process discovery on our blog http://blog.actionbase.com/in-situ-process-discovery)." |
When you think of Activities on IBM Lotus Connections they are practicing this in an organic way. Activities (and Google Wave), are a collaboration tool to work on a task, where everything is recorded, and lives on a URL. Common activities can be available as templates eg. if you have to organise an event, there’s no doubt many have done this before using "Activities", so why not start by re-using a template, and re-mix it to your context.
See a video called "The man who should have used Lotus Connections 5 - Innovate or Die"
Human Process Management
ActionBase call this Human Process Management (which is what people may refer to as BPM 2.0).
In the post, The ‘H’ Bomb in Business Process Management, they state how traditional BPM does not reflect the reality of work:
|
"Human work is: Dynamic Tacit Ad hoc Crossing boundaries and silos Saturated with peer to peer interaction If you want to manage a human workflow like fraud investigation or a product change request or any other, you need to accept the “chaos” and face the facts - structured, rigid process does not fit into this paradigm." |
Following on, the post, What is a Human Process?, re-iterates what has already been reviewed in this post, ie. the co-existence of routine and tacit interactions:
|
"Human processes are business processes that generate a business outcome that is heavily dependent on interactions between people. These are also called “tacit interactions” by economists, which is an attempt to differentiate between routine transactions and interactions that rely heavily on judgment and context. These “tacit interactions” are the most prevalent kind of business processes in which knowledge workers take part. Most of the work of involved in executing these human processes is with the communication, coordination and management aspects of the process. Currently most human processes in business are executed using standard productivity tools (e.g. MS Office), email (e.g. Outlook) and meetings. |
I have listed just a few of their characteristics involved in human processes:
|
"Unstructured - there is a standard framework for the process and how to achieve the intended result, but each case is handled separately and requires human understanding (for both decisions and flow) as part of the process. There isn’t enough standardization between instances of the process that allows for a formal, complete and rigorous description of the process end-to-end. Dynamic - the flow of the process changes on a case by case basis, based on available information and human decisions. A flow can also change while the process is being executed based on new information, or a changing environment." |
Then they put it altogether as, What is Human Process Management (HPM)?
Mike Cohn takes this to the human behaviour, and change aspect, where enabling and empowerment from the bottom-up is key to adoption, as workers have a finger in the process pie that they will be using:
|
"None of the agile processes as described by their originators is perfect for your organization. Any may be a good starting point, but you will need to tailor the process to more precisely fit the unique circumstances of your organization, individuals, and industry. As Alistair Cockburn once told me, “Having a chance to change or personalize a process to fit themselves seems to be a critical success factor for a team to adopt a process. It’s the act of creation that seems to bind teams to ‘their own’ process.”" |
Enterprise 2.0 - Complementing and Supplementing existing processes, and assembling new ones
Bertrand Duperrin has an excellent post on the three streams of enterprise 2.0 which puts an understanding out there that enterprise 2.0 is not about some isolated fairy-shary thing that happens on the edges of the organisation…he also posts about it here. Besides serendipity, and formal communications, it’s also about complementing and supplementing existing processes. He says:
|
"Becoming an enterprise 2.0 is not a goal for any enterprise and should not be. The only one is : improving the way things are done everyday, the way it produces. But what does “production” really mean ?" |
1. Formal Production Capability (FPC):
|
"Being able to produce something defined, following a process in which everyone knows exactly what he has to do, when, and how." |
2. Ad-hoc Production Capability (APC):
|
"Being able to overcome any breakdown or insufficiency […] goods and services have to be more and more customised. As a consequence, production is less and less standardized and the need for readjusting it according to clients who have more and more specific requests is not an accident anymore but a norm […] their unpredictability has to be admitted and a framework has to be defined in order, even if things are not under control in the strict sense of the word, they respect some essential rules. Paying no attention to that and focusing on the traditional FPC causes many dysfunctions and put employees in unbearable situations." |
3. Serendipity production Capability (SPC):
|
"Being able to innovate and produce unexpected things […] has to be facilitated because it’s key in a disruptive economy" |
He puts this into perspective using a comparison table, and concludes:
|
"…businesses have to develop these three points. Not one of them, all of them […] Companies should facilitate the switch between these three systems because it’s what people need to get things done […] There’s no unique satisfactory way of doing things. People have to know how to switch from one to another. |
Bertrand has a related post on being adaptive and agile, which I will highlight in a future post.
Co-existence of processes and ad-hoc work
Many I have quoted admit that "process" is a good thing, but extreme standardisation, rules and rigidness can trap people, creating unproductiveness and inefficiencies which is counter to what you are trying to automate in the first place. The key is for some flexibility in the process to cater for change, contexts, and the unpredictable…and to also be able to assemble people and tools to create your own ad-hoc processes.
Ross Mayfield on the folly of process extremism:
|
"…processes can become calcified and accepted as the rule even when they do not work and make no sense." |
I like how Ross sees a process more as a framework, that can be built upon or bendable (similar to Ross Dawson’s view of enterprise 2.0 approaches):
|
"A process is like a standard. It provides a common definition for others to build upon. This is generally a good thing […] At best, a process should serve as a reference model. Something that others can reference when completing a task. Something that can be leveraged for innovation, a boundary condition for experimentation at the margin." |
Nicholas Carr shares his middle ground:
|
"…meticulously defined and managed processes continue to be a powerful source of competitive advantage for many companies. Look at Toyota, for instance. Its highly engineered manufacturing processes not only give it superior productivity but also provide a platform for constant learning and improvement. The formal structure, which is anything but democratic, spurs both efficiency and innovation - productive innovation - simultaneously" |
Nicholas talks about how new tools complement processes:
|
"The simple group-forming and information-sharing software tools now being introduced and refined will often provide greater flexibility and effectiveness than more complex "knowledge management" systems. But even in these cases, processes aren’t going away; they’re just changing. There can’t be organization without process." |
He concludes:
|
"Bad processes can destroy individual initiative, but well-designed processes, even very formal ones, can encourage individual initiative and, importantly, guide personal and group creativity toward commercially productive ends. I’m not sure you need to balance process and people so much as harmonize them" |
Irving Wladawsky-Berger reminds us not all processes deal with unstable environments:
|
"…we need to standardize those processes where differentiation brings little or no incremental value, so as to avoid the huge inefficiencies involved in re-inventing the same process over and over again." |
And also share’s his middle ground:
|
"An innovative business looks for the proper balance between process - covering those aspects of the business that can be designed, standardized, and increasingly automated - and people - who bring their creativity and |
Mark Masterson’s insightful take on it is:
|
“The problem is not business processes. The problem is trying to automate business processes." |
Mark’s insight in detail:
|
"We are more efficient than before, but we’re disappointed nevertheless. Yes, our coordination costs are lower than they were with ad hoc and / or manual processes. But now we want more! We want to keep enjoying these improvements in efficiency and productivity, but we want the creativity and innovativeness back, which we are somehow certain that we’ve lost" |
Phil Gilbert reminds us where we started:
|
“The traditional notion of a business process comes from the manufacturing world where you can standardise the inputs and outputs of a given process,” he explains.“With ‘white collar’ processes, the very reason you have human beings doing them is that you cannot standardise those inputs and outputs.” |
Sigurd Rinde reminds us too:
|
"If work was like a water flow and the given framework was the pipe it flows through, then BPM would be the system whereby pipes were shifted from side to side and valves opened and shut to direct changes to the flows. Good enough if the flow is water. Not so good if the water molecules had a mind of their own and actually were able to make directional decisions underway. Funny thing, people can. And more; it’s wanted because people are smarter than machines and that’s why you hired them. Ever broken business rules or botched the main systems just so you actually can get your job done? But of course you have." |
This takes us, as always, to being more effective and agile.
Mike Gotta quotes a HBS article:
|
"Many organizations struggle to balance the conflicting demands of efficiency and innovation. Organizations can become more efficient in the short run by replacing costly, unpredictable problem solving activity with consistent, |
Endnote
Often enterprise 2.0 is synonymous with "emergence" and "free-form" which mostly relates to what surfaces from people sharing and conversing about what they know. But "emergence" and "free-form" also relates to "processes"…how do I work around a process by being empowered with new bottom-up enabling tools. And what may emerge from using these free-form tools is things like a wiki page to list what to do in different contexts, troubleshooting tips that complement procedures, etc…see my post, Wikis for exceptions and process failures.
In the future I want to look more deeply into integration 2.0..social computing blended with designed process tools.
This post could keep going but I’ll stop here. Some related areas are; the addiction to Best Practices, stifling innovation, Management 2.0, Plans and Targets, and Complexity (uncertainty, unpredictable)…which I plan to post about.
Related
Socialize your business ? What does it mean ?
The Everything 2.0 discussion - the real issue
Process problems and one answer from thingamy














Excellent job of piecing together a wide array of quotes.
The key challenge as I see it in my company is adoption of such tools by the baby boomers who still feel comfortable sending emails to a small target audience rather than the community who can collaborate/benefit/answer. Also I totally agree with you that E2.0 tools provide a platform to create ad-hoc process for “management by exception” situations however exceptions typically is a reflection of process (and people) broken and at least in our 30,000 people company folks are reluctant to want to talk about such issues in an open forum. Rather they will talk about success therefore the E2.0 platform is becoming a tool for folks to cleverly share (selectively) their achievements- you could argue that’s a good thing, but it’s missing the mark on what the purpose for such a tool is.
The people aspect and adoption strategies are areas I will like to hear more about,
Comment by Sam — May 29, 2010 @ 4:04 pm
Thx for your comment Sam. This post was about ad-hoc collaboration which we can now do using new tools.
You talk about adoption of these tools which is another post I may review in the future. Yes a change to work-in-progress sharing and communicating.
http://libraryclips.blogsome.com/2008/03/11/km-20-doing-your-job-or-giving-back-to-the-organisation/
http://libraryclips.blogsome.com/2008/02/25/the-value-of-networked-free-form-publishing/
Just quickly I think one path to adoption is facilitating the use of these tools to fix burning issues. How can we communicate better, how can we troubleshoot better, how can we do document review better, how can we fix processA better
And also it’s key to have activists and a few senior people as role-models so they can be an influence on others
…don’t try and boil the ocean…just infect a few and let the virus do its thing. If people see successes from their peers they will want some of that.
Comment by John Tropea — May 30, 2010 @ 1:39 am
Hi John,
Interesting post!
I will surface just two elements of it:
1) When Ross Mayfield says that “Most employees don’t spend their time executing business process. That’s a myth. They spend most of their time handling exceptions to business process.” he just recognises that we are out of the supply driven economy (that leads to stable bureaucratic forms of management) and have entered a demand driven economy. Quality Management literature is all about that, for 30 years now. The reason why we pay people and not implement sophisticated processes is that Humans are agile in the sense that they have the ability to handle unanticipated issues, whether it is future or specificity of a customer request. People are necessary, because knowledge is necessary.
2) Email and Attachment are imperfect and temporary technological arrangements, that survive only by routine. They are not perfect as a) this duplicates content and makes reconciliation difficult and 2) this hides individual contribution (aka versioning). Social computing is a useful complement to Email and Attachment as it helps addressing the “making of” by centralising and versioning the content. Other attributes of social computing tools such as notifications prove helpful to speed the co-ordination up. All those elements are useful to embed knowledge management in work-related activity.
http://www.scribd.com/doc/13908244/The-Adaptation-of-Organisations-to-a-Knowledge-Economy-and-the-Contribution-of-Social-Computing
Comment by Olivier Amprimo — May 31, 2010 @ 2:05 pm
Nice to hear from you Olivier.
Totally correct, the big picture is now a demand driven economy.
It still is but was even more so the case that consumers are victims of economies of scale, and homogenity (any colour as long as it’s black), as over surplus means a need to create demand via marketing.
But I think all this is changing where the customer has specific needs (products/services need to be modular and accommodating), they even co-create, and they trust each other (eg. travel reviews by other customers)
Thx for your Scribd piece, I am familiar with this and may review it one day, as it’s very high level.
Comment by John Tropea — May 31, 2010 @ 10:31 pm
Hi John,
You might want to consider Marketing as the technics that bridges the gap between supply-side / economies of scale driven economy and demand-side / long tail economy, whereby segmentation is a communication strategy and marginal customization is a production strategy. Bridge because it is right between one and the other.
Re, my Scribd piece, I wanted to address people who make decisions and don’t quite relate things as they keep on assimilating KM and social computing to operational matters. The Knowledge-based view of the firm remains poorly regarded, that is precisely why “Enterprise 2.0″ makes no impact.
PS: for God’s sake, please change your captcha!
Comment by Olivier Amprimo — June 1, 2010 @ 1:04 pm
There’s also confusion in the enterprise regarding the identified need for collaboration, individual contributions, and automation in driving business solutions. By confusing standardized actions with exception handling, companies have ended up with sub-optimal collaboration practices and information prioritization.
Comment by Hyoun Park — June 1, 2010 @ 4:31 pm
Thx for the follow-up comment Olivier.
Hyoun,
Yes, as Deb Lavoy says, collaboration isn’t considered normal, it’s more management by fear.
But this doesn’t change the fact that we have wicked problems or need to draw on others not on our teams to get things done
http://bit.ly/9XPzbD
We collaborate the best we can to cope in dealing with our issues…we have a barter organisation (you help me I help you)
As you allude to the organisation needs to notice how we cope using email to do ad-hoc collaboration, and how much more effective this could be using new social tools.
Yes sub-optimal ways to tap into information, filter it, add value…and sub-optimal ways to handle exceptions. I really like flexible tools like Traction Software that create a more optimal way for you do design bottom-up ad-hoc processes.
At the same time this learned behaviour needs to be not an objective, but a practiced value from the top-down, just like safety and quality.
Some things to iron out are work group fatigue and how we are appraised in working collaboratively
http://libraryclips.blogsome.com/2009/12/17/the-roi-of-time-spent-helping-others-and-performance-reviews/
http://libraryclips.blogsome.com/2009/11/23/work-group-fatigue-level-of-effort-vs-funded-or-transform-the-organisation/
What are your thoughts in these two links above Olivier
Comment by John Tropea — June 1, 2010 @ 10:25 pm