Skip to content

{ Category Archives } BPA

Architecture & Process: Robert Shapiro

I met Robert Shapiro years ago, when I worked for FileNet and he was part of the impressive brain trust at Meta Software, but now he’s with Global 360 and here to talk to us about BPM and workforce management, which focuses on using analytics, simulation tools and optimization techniques together with a workforce scheduler.

He started with a quick overview of simulation in a BPMS environment, where a discrete event simulation is run based on scenarios that include the following:

  • A set of processes to be simulated
  • Incoming work (arrivals), both actual (from a BPMS or other operational system) and forecast
  • Resources, roles and shifts, including human, equipment and technology resources
  • Activity details, including the duration of each activity (likely a distribution) and the probability of each decision path.

The output of the simulation will show the staff requirements by role and time period, staff and equipment utilization, cycle times and SLAs, unprocessed work and bottlenecks, work arrival profile, and an activity summary.

He then went on to discuss workforce management schedulers, which is used to assign detailed schedules to staff within an organization based on the work load and the resource characteristics (usually from an HR management system). Note that I’m not talking about assigning work within a BPMS here; this is more general scheduling technology for creating a schedule for each resource while trying to precisely match the work load. Factors such as holidays, vacation, union rules and other factors that determine who may do what are all taken into account.

One of the key inputs into a workforce scheduler, however, is exactly what’s output from a process simulator: workload demand on a time basis. By working with these technologies together, it’s possible to come up an optimal workforce size and schedule as follows:

  • Gather analytics from a BPMS on work arrival patterns, resource utilization, work in progress and activity loads in order to extract workload demand (staff requirements by role and time period) for input to the scheduler.
  • Using the actual workload demand data and other data on individual staff characteristics, generate a best-fit schedule in the scheduler that matches workload and staff, minimizing under and overstaffing.
  • Feed the best-fit resource schedule back into the process simulator, and create a scenario based on this schedule and the actual analytics from the BPMS. The simulation can create an updated version of the workload demand and the effect of the new workforce assignment.
  • The workload demand generated by the simulator is fed back into the scheduler, which generates a new best-fit resource schedule.
  • Rinse and repeat (or rather, simulate and schedule) until no further optimization is possible.

This approach is most suited to well-structured business processes with repeatable patterns in work item arrivals, and a large total resource pool — Shapiro has seen 10-20% reduction in staff costs when these techniques are applied. A bit of scary old-style BPR fears here about cutting jobs, but that’s the reality in many industries.

Tagged ,

ProcessWorld 2008: Michael Blechar, Gartner

You would think that I had enough of Gartner last week in Las Vegas, but here I am at yet another Gartner presentation.

Although Gartner is a big proponent of buying everything in a BPM suite (including modeling) from one vendor, Michael Blechar is here to play nice and talk about best-of-breed modeling and analysis using tools such as ARIS — even going so far as to refer to it as the “Cadillac of BPA”. They completely underestimated the interest in this track, and the room is standing room only.

He looked at the three major types of BPA tool buyers: business process modelers, (enterprise)architects, and BPMS modelers (who are concerned with the actual implementation within a BPMS execution environment, hence focused on design and construction). BPMS modelers typically start with the modeling tool provided by the BPMS, then may add in a more comprehensive modeling environment after implementing one or two processes and finding that the modeling tool is inadequate, whereas business process modelers are typically creating models independent of any particular execution implementation. In many cases, business process modelers are starting with Microsoft Visio because it’s the most readily available tool, but find that they need something much more robust for modeling, providing functionality such as activity-based costing and simulation.

He reviewed the players in the recently-published BPA magic quadrant, where IDS Scheer sits as the clear top-right leader. This market is undergoing a lot of consolidation, mostly as BPA vendors are being acquired by BPMS vendors; surprisingly, the magic quadrant only has leaders and niche players (bottom left), but nothing in the challengers or visionaries quadrants. Personally, I wouldn’t have put Microsoft (with Visio) in the leaders quadrant; although they are clearly a dominant force in the market, their product is pretty low-end compared to the real contenders: IDS Scheer, Proforma, Mega, iGrapfx, Telelogic and Casewise.

Blechar is talking about how in the future, Microsoft and others will allow you to create models that actually execute without writing code, but isn’t this what almost all BPMS products do now? There’s some confusing stuff going on in this presentation from a BPMS viewpoint, such as talk about the convergence of BPMN and UML, and an over-emphasis on BPEL as a cornerstone.

He finished up with some recommendations:

  • When BPM initiatives reach the point of requiring business architecture definition — or there is a need to visualize, simulate, animate or automate business process as models — BPA tools should be implemented.
  • As business look to implement business processes in a service-oriented architecture, there is an increased urgency to collaborate more closely with IT archtiects and analysts including shared models.
  • Be pragmatic in scoping modeling efforts: do not try to “boil the ocean” in terms of modeling the “as-is” and “to-be” business architecture and processes.
  • Ensure the key business roles of business process owner, architect and analyst are staffed and enabled.
  • Monitor standards efforts and be prepared to use increased model automation tools and techniques.
  • Match BP methods and tools to the primary focus group of usrs - be they BP modelers, architects or BPMS modelers.
  • Monitor opportunities to purchase pre-built models to jump-start your BPI projects.

ProcessWorld 2008: Prof. Dr. August-Wilhelm Scheer Keynote

I had completely forgotten last year’s jazz performance until Dr. Scheer arrived on stage for his keynote toting a saxophone, and had a quick session with bass, keyboard and drums before starting the keynote.

His presentation focus was on a framework for business performance management: a holistic management concept for improving performance and profitability of a company via two BP(e)M [Business Performance Management] wheels. He started with a content wheel that included several of the dimensions along which to consider business performance management initiatives, through three phases of market maturity (roughly, pre-2000, 2000-current, and future). For example, “objects”, or the artifacts captured to drive the frameworks, has shifted from data to processes, and is starting to move to events and rules.

He moved on to a technology wheel model, covering various aspects of application architecture, as they moved from standalone process models to tight integration with ERP packages — which effectively acts as the business process execution layer — to the emerging generation of model-driven business software.

He overlaid these wheels with areas covered by classical BI and BPM to show the gaps between ARIS and other classes of products, and showed how it could be used for evaluating process improvement efforts to date within an organization.

Upcoming conferences

I’ll be attending three conferences in the next three weeks (after a hiatus of over two months, it’s going to be strange to get back on a plane), and live-blogging from each conference, wifi permitting.

Next week is the Gartner BPM summit in Las Vegas: one of the key BPM conferences of the year (at least, until Gartner watered it down by running a second one in September last year). The presentations are typically a mix of Gartner analysts discussing BPM, SOA and related subjects, and customers discussing their implementations. The trade show includes every BPM vendor who wants to be taken seriously in this market. Expect to see some of my posts from this week syndicated over on Intelligent Enterprise, plus I’ll be doing a wrap-up article at the end of the week exclusively on their site.

February 13-15 is ARIS ProcessWorld in Orlando, IDS Scheer’s user conference. I attended this last year and enjoyed it; last year was only the second time that I’d been to any sort of process modelling user conference (having attended Proforma’s conference in 2006), and it’s really valuable to see how the front-end modelling tools fit together with the BPMS that automate those processes. IDS Scheer is paying my travel expenses to attend.

February 18-20 I’m back in Orlando for FASTforward, which is sort of a user conference for FAST enterprise search (which is being acquired by Microsoft), but really goes beyond that cover a lot of Enterprise 2.0 territory. Featured speakers include Andrew McAfee, Tom Davenport and Don Tapscott, all of whom I’ve written about in the past couple of week. You can register for FASTforward here, and put my name (Sandy Kemsley) in the reference field so that they know where you came from. FAST is paying my travel expenses to attend. All of my live-blogging posts will be cross-posted to the FASTforward blog, and I’ll do a daily wrap-up post exclusive to their site.

As an aside, I’ve consolidated all posts for all Gartner BPM coverage under one category regardless of year, and all for ProcessWorld under their own category.

If you’re going to be at any of these events, look me up.

Getting Metastorm BPM and ProVision to work together

In response to a post that I wrote back in August about Metastorm acquiring Proforma, Jerome Pearce recently wrote the following comment:

I have just tried to convert a ProVision workflow model to a Metastorm BPM (e-work). I cannot see how it could produce a proper process in e-work. The concepts of the two packages do not map well.

Can anyone actually show me a design in ProVision that has been converted to Metastorm BPM using the provided Exchange tool? Nothing I have ever come up with in e-work could be properly represented in ProVision as the elements do not really match. There is no concept of ‘Stage’ in ProVision, and the use of Map Segments for sub-workflows makes the result very difficult to change (which is after all the whol point of e-work).

can anyone show us a real example?

I reproduce this here since I think that a lot of people don’t follow the comments feed so would miss a comment on an older post.

Any ideas on solving Jerome’s problem?

TIBCO webinar: Why and how to move ahead with BPM and SOA

I’ve missed a few of the TIBCO webinar series this summer, such as the one on BPMN, and wanted to tune into this one to look at the modelling-to-execution process as TIBCO presents it.

They’re using a different webinar provider this time — the webinars that I did with them were all done with Webex, and we had one live failure that was a bit inconvenient although not disastrous. Ironically, the one slide that was incorrectly rendered in today’s presentation was related to visibility:

Lack of visibility

Emily Burns starts out with some starting slides on why people are implementing BPM. Reason #1: peer pressure from all your competitors that you read about in the Forrester and Gartner reports. :)  She quoted some interesting recent Forrester research that showed that a little over half of the respondents have an SOA strategy, and about 2/3 of the respondents that have some level of BPM consider it critical for their SOA strategy.

Jason McMahon of AmeriCredit was up next to talk about how they used TIBCO in their automotive loan servicing: 25,000 new loans each month, and over a million active loans. They had to streamline their processes and provide greater visibility into the processes, as well as ensure that they’re meeting regulatory requirements as they expand into new geographic regions. They had a fairly fast deployment cycle: the project kicked off in Q106, design started in Q2, development in Q3, and they were rolling it out in January 07. Version 2 is almost ready to go live. They saw a number of benefits:

  • Optimized business process by doing the “deal-killer” due diligence checks up front and reducing hand-offs
  • Customized processing of contracts by state/country (AmeriCredit operates in Canada, despite their name) and type of loan
  • Business process visibility, including better resource management, and automated alerts and reporting
  • Reduced training time since the rules are embedded in the process
  • Outsourcing readiness so that they can add in an outsourcing vendor for contract data entry (which is available now from at least one provider but not in use at AmeriCredit) and data validation/verification processes

McMahon sees a strong need for BPM-driven SOA design, where BPM is the consumer of services and therefore defines a big part of the requirements for services. This includes discovering services by looking at the current EAI-type integration points in existing processes, as well as during the design of future processes. Outside the actual process, there’s also a number of services that are required to service the processes even though they’re not called directly from the BPMS, such as process triggering events, user/role management, and open/close/purge of cases.

He talked in detail about what AmeriCredit has done with web services, including wrapping business rules/logic in web services so that they can be called from both a non-BPM web interface and the BPMS — exactly the reason that I believe in the separation of BPM and BR. He stepped through a number of best practices for defining services, such as establishing the appropriate level of granularity and ensuring encapsulation of some systems, then continues with an example of looking at a process with its existing integration points and combining the appropriate ones into specific web services.

Since they started with BPM and drove towards SOA, they ended up with a very BPM-focussed SOA, much of it defined by the BPM integration points but also with consideration of other applications that might share the same services.

McMahon’s last words of wisdom: using the BPM tool is simple for redesigning the processes; the hard part is having business users buy in to what the future-state processes should be, and you need a good business analyst to be the mediator here.

They use TIBCO’s iProcess for BPM and BusinessWorks for SOA, in case you haven’t guessed that already. Other implementation points: they built the entire UI in .Net, and extract the process data to a data warehouse for BI rather than hitting the BPMS directly.

A recording of the presentation will be available over the next few days, watch the TIBCO site for details or maybe someone from TIBCO will post the link here as a comment (hint, hint). You can check out the slides here, but you’ll really want to hear the audio as well, especially the Q&A.

Process discovery, modeling and design webinars

I recently did a series of three webinars for TIBCO: process discovery, process modeling and process design (full replays with audio available at the links).

If you just want to browse through the slides again, I’ve embedded them below. You can move between slides using the controls below each set of slides, or click through to SlideShare for a larger version.

Generalists and specialists

Specialist or generalist?Great graphic by Dave Gray of XPLANE, showing the difference between generalists and specialists. Click through on the image to his Flickr page to see in full resolution, or view it directly on his blog, there’s a lot of other great material there.

His key point: generalists are best at defining the problem or goal, while specialists are best at solving the problem or executing the plan.

Wisdom of the crowdI met Dave at VizThink3 in Toronto this summer, where he led us through some exercises in visual thinking; I’m more of a written word sort of person, so these exercises were good at stretching my brain a bit; I even drew a visual representation of crowdsourcing. I think that my drawing skills need a bit of work.

BPM is one of those areas where a structured type of visual thinking is used: most often, people draw a process flow to represent their business process, and that visual representation (now standardized in BPMN) has become the primary way for specifying processes for automation. Although Dave’s work focusses in a great part on visuals for marketing and training communications, process visualization is part of what they do; check out their website for the Standard & Poor’s example, where the process map looks like a subway route map.

More on the Metastorm-Proforma acquisition

Metastorm CEO Bob Farrell gave a briefing this morning about their acquisition of Proforma; not much that wasn’t covered in the press release except the following:

  • Their customers were demanding BPA functionality that obviously went beyond what they offered as part of their BPMS.
  • They’ll be using Proforma’s CIF as an interchange format — a major mistake for process models in my opinion. Although CIF does provide support for a number of other enterprise architecture model types, they’re really going to be using this for getting process models into the Metastorm BPMS execution environment. In a post that I did at the end of the Proforma user conference last year, I noted that in spite of their lip service to standards, they only support BPEL export via a CIF remapping, XPDL wasn’t on their roadmap yet, and I’m not sure that they had started to think about BPDM. Of course, if they abandon the hope of selling ProVision to users of other BPMS’, then this may not matter much since it will just be an internal interchange standard between their own tools.

Metastorm acquires Proforma

Metastorm announced today that they’ve acquired Proforma. Strangely, the Proforma URL already remaps directly to the Metastorm site and the products are already relabelled as “Metastorm ProVision”; most acquired companies keep their own site and brand visible for a while so as to not freak out customers who haven’t heard about the acquisition yet.

I covered the Proforma user conference last year; I’ve always been impressed with their modelling tool since it goes beyond process modelling to full enterprise architecture modelling, and they seem to be moving in the right direction with increasing their browser-based modelling capabilities to allow this to be rolled out to a greater user base within an organization. They’re currently leaders in both the BPA space and the EA modelling space.

There’s still the round-tripping problem, however: I haven’t been briefed on this by either party, but based on my past conversations with Proforma, I’m suspecting that it’s a one-way trip from Proforma’s modelling environment to Metastorm’s process execution environment, since you likely have to tweak the modelled process significantly in order to make it run, and they likely aren’t supporting an extensible interchange format that would allow those changes to stay with the model if it were moved back to the modelling environment. I’m just guessing on this, of course, and would love to hear different. And, although Metastorm was one of the first vendors to offer a free downloadable process modelling tool, I can’t find that on their site any more, so they may be putting all of their process modelling eggs in the ProVision basket.

Metastorm bought CommerceQuest in late 2005 to improve their integration-centric BPM capabilities, and this acquisition rounds out the front end of their product suite — Forrester gave them a black mark in last year’s report for relying too much on third-party software, and this directly addresses that concern. The trick, as with any acquisition, will be how seamlessly that they’re able to integrate Proforma’s products.

Webinar Q&A

I gave a webinar last week, sponsored by TIBCO, on business process modeling; you’ll be able to find a replay of the webinar, complete with the slides, here). Here’s the questions that we received during the webinar and I didn’t have time to answer on the air:

Q: Any special considerations for “long-running” processes - tasks that take weeks or months to complete?

A: For modeling long-running processes, there’s a few considerations. You need to be sure that you’re capturing sufficient information in the process model to allow the processes to be monitored adequately, since these processes may represent risk or revenue that must be accounted for in some way. Second, you need to ensure that you’re building in the right triggers to release the processes from any hold state, and that there’s some sort of manual override if a process needs to be released from the hold state early due to unforeseen events. Third, you need to consider what happens when your process model changes while processes are in flight, and whether those processes need to be updated to the new process model or continue on their existing path; this may require some decisions within the process that are based on a process version, for example.

Q: Do you have a recommendation for a requirements framework that guides analysts on these considerations, e.g. PRINCE2?

A: I find most of the existing requirements frameworks, such as use cases, to be not oriented enough towards processes to be of much use with business process modeling. PRINCE2 is a project management methodology, not a requirements framework.

Q: The main value proposition of SOA is widely believed to be service reuse. Some of the early adopters of SOA, though, have stated that they are only reusing a small number of services. Does this impact the value of the investment?

A: There’s been a lot written about the “myth” of service reuse, and it has proved to be more elusive than many people thought. There’s a few different philosophies towards service design that are likely impacting the level of reuse: some people believe in building all the services first, in isolation of any calling applications, whereas others believe in only building services that are required to meet a specific application’s needs. If you do the former, then there’s a chance that you will build services that no one actually needs — unlike Field of Dreams, if you build it, they may not come. If you do the latter, then your chance of service reuse is greatly reduced, since you’re effectively building single-purpose services that will be useful to another application only by chance.

The best method is more of a hybrid approach: start with a general understanding of the services required by your key applications, and use apply some good old-fashioned architectural/design common sense to map out a set of services that will maximize reusability without placing an undue burden on the calling applications. By considering the requirements of more than one application during this exercise, you will at least be forcing yourself to consider some level of reusability. There’s a lot of arguments about how granular is too granular for services; again, that’s mostly a matter that can be resolved with some design/development experience and some common sense. It’s not, for that matter, fundamentally different than developing libraries of functions like we used to do in code (okay, like I used to do in code) — it’s only the calling mechanism that’s different, but the principles of reusability and granularity have not changed. If you designed and build reusable function libraries in the past, then you probably have a lot of the knowledge that you need to design — at least at a conceptual level — reusable services. If you haven’t built reusable function libraries or services in the past, then find yourself a computer science major or computer engineer who has.

Once you have your base library of services, things start getting more interesting, since you need to make sure that you’re not rewriting services that already exist for each new application. That means that the services must be properly documented so that application designers and analysts are aware of their existence and functionality; they must provide backwards compatibility so that if new functionality is added into a service, it still works for existing applications that call it (without modifying or recompiling those applications); and most important of all, the team responsible for maintaining and creating new services must be agile enough to be able to respond to the requirements of application architects/designers who need new or modified services.

As I mentioned on the webinar, SOA is a great idea but it’s hard to justify the cost unless you have a “killer application” like BPM that makes use of the services.

Q: Can the service discovery part be completely automated… meaning no human interaction? Not just discovery, but service usage as well?

A: If services are registered in a directory (e.g., UDDI), then theoretically it’s possible to discover and use them in an automated fashion, although the difficultly lies in determining which service parameters are mapped to which internal parameters in the calling application. It may be possible to make some of these connections based on name and parameter type, but every BPMS that I’ve seen requires that you manually hook up services to the process data fields at the point that the service is called.

Q: I’d be interested to know if you’re aware of a solid intro or training in the use and application of BPMN. I’ve only found general intros that tend to use the examples in the standard.

A: Bruce Silver offers a comprehensive course in BPMN, which I believe it available as either an online or classroom course.

Q: Does Data Object mean adding external documentation like a Word document into the BPM flow?

A: The origin of the data object is, in part, to serve the requirements of document-centric BPM, where the data object may represent a document (electronic, scanned paper, or a physical paper document) that travels with the workflow. Data objects can be associated with a sequence flow object — the arrows that indicate the flow in a process map — to show that the data artifact moves along that path, or can be shown as inputs and outputs to a process to show that the process acts on that data object. In general, the data object would not be documentation about the process, but would be specific to each instance of the process.

Q: Where is the BPMN standard found?

A: BPMN is now maintained by OMG, although they link through to the original BPMN website still.

Q: What is the output of a BPMN process definition? Any standard file types?

A: BPMN does not specify a file type, and as I mentioned in the webinar, there are three main file formats that may be used. The most commonly used by BPA and BPM vendors, including TIBCO, is XPDL (XML Process Definition Language) from the Workflow Management Coalition. BPEL (Business Process Execution Language) from OASIS has gained popularity in the past year or so, but since it was originally designed as a web service orchestration language, it doesn’t include support all of the BPMN constructs so there may be some loss of information when mapping from BPMN into BPEL. BPDM (Business Process Definition Metamodel), a soon-to-be-released standard from OMG, promises to do everything that XPDL does and more, although it will be a while before the level of adoption nears that of XPDL.

Q: What’s the proper perspective BPM implementers should have on BPMN, XPDL, BPEL, BPEL4People, and BPDM?

A: To sum up from the previous answer: BPMN is the only real contender as a process notation standard, and should be used whenever possible; XPDL is the current de facto standard for interchange of BPMN models between tools; BPDM is an emerging standard to watch that may eventually replace XPDL; BPEL is a web service orchestration language (rarely actually used as an execution language in spite of its name); and BPEL4People is a proposed extension to BPEL that’s trying to add in the ability to handle human-facing tasks, and the only standard that universally causes laughter when I name it aloud. This is, of course, my opinion; people from the integration camp will disagree — likely quite vociferously — with my characterization of BPEL, and those behind the BPDM standard will encourage us all to cast out our XPDL and convert immediately. Realistically, however, XPDL is here to stay for a while as an interchange format, and if you’re modeling with BPMN, then your tools should support XPDL if you plan to exchange process models between tools.

I’m headed for the BPM Think Tank next week, where all of these standards will be discussed, so stay tuned for more information.

Q: How would one link the business processes to the data elements or would this be a different artifact altogether?

A: The BPMN standard allows for the modeler to define custom properties, or data elements, with the scope depending on where the properties are defined: when defined at the process level, the properties are available to the tasks, objects and subprocesses within that process; when defined at the activity level, they’re local to that activity.

Q: I’ve seen some swim lane diagrams that confuse more than illuminate - lacking specific BPMN rules, do you have any personal usage recommendations?

A: Hard to say, unless you state what in particular that you find confusing. Sometimes there is a tendency to try to put everything in one process map instead of using subprocesses to simplify things — an overly-cluttered map is bound to be confusing. I’d recommend a high-level process map with a relatively small number of steps and few explicit data objects to show the overall process flow, where each of those steps might drill down into a subprocess for more detail.

Q: We’ve had problems in the past trying to model business processes at a level that’s too granular. We ended up making a distinction between workflow and screen flow. How would you determine the appropriate level of modeling in BPM?

A: This is likely asking a similar question to the previous one, that is, how to keep process maps from becoming too confusing, which is usually a result of too much detail in a single map. I have a lot of trouble with the concept of “screen flow” as it pertains to process modeling, since you should be modeling tasks, not system screens: including the screens in your process model implies that there’s not another way to do this, when in fact there may be a way to automate some steps that will completely eliminate the use of some screens. In general, I would model human tasks at a level where a task is done by a single person and represents some sort of atomic function that can’t be split between multiple people; a task may require that several screens be visited on a legacy system.

For example, in mutual funds transaction processing (a particular favorite of mine), there is usually a task “process purchase transaction” that indicates that a person enters the mutual fund purchase information to their transaction processing system. In one case, that might mean that they visit three different green screens on their legacy system. Or, if someone wrote a nice front-end to the legacy system, it might mean that they use a single graphical screen to enter all the data, which pushes it to the legacy system in the background. In both cases, the business process is the same, and should be modeled as such. The specific screens that they visit at that task in order to complete the task — i.e., the “screen flow” — shouldn’t be modeled as explicit separate steps, but would exist as documentation for how to execute that particular step.

Q: The military loves to be able to do self-service, can you elaborate on what is possible with that?

A: Military self-service, as in “the military just helped themselves to Poland?” :) Seriously, BPM can enable self-service because it allows anyone to participate in part of a process while monitoring what’s happening at any given step. That allows you to create steps that flow out to anyone in the organization or even, with appropriate network security, to external contractors or other participants. I spoke in the webinar about creating process improvement by disintermediation; this is exactly what I was referring to, since you can remove the middle-man by allowing someone to participate directly in the process.

Q: In the real world, how reliable are business process simulations in predicting actual cycle times and throughput?

A: (From Emily) It really depends on the accuracy of your information about the averages of your cycles. If they are relatively accurate, then it can be useful. Additionally, simulation can be useful in helping you to identify potential problems, e.g. breakpoints of volume that cause significant bottlenecks given your average cycle times.

I would add that one of the most difficult things to estimate is the arrival time of new process instances, since rarely do they follow those nice even distributions that you see when vendors demonstrate simulation. If you can use actual historical data for arrivals in the simulation, it will improve the accuracy considerably.

Q: Would you have multiple lanes for one system? i.e. a legacy that has many applications in it therefore many lanes in the legacy pool ?

A: It depends on how granular that you want to be in modeling your systems, and whether the multiple systems are relevant to the process analysis efforts. If you’re looking to replace some of those systems as part of the improvement efforts, or if you need to model the interactions between the systems, then definitely model them separately. If the applications are treated as a single monolithic system for the purposes of the analysis, then you may not need to break them out.

Q: Do you initially model the current process as-is in the modeling tool?

A: I would recommend that you at least do some high-level process modeling of your existing process. First of all, you need to establish what the metrics are that you’re establishing for your ROI, and often these aren’t evident until you map out your process. Secondly, you may want to run simulations in the modeling tool on the existing process to verify your assumptions about the bottlenecks and costs of the process, and to establish a baseline against which to compare the future-state process.

Q: Business Managers : concerns - failure to achieve ROI ?

A: I’m not exactly sure what this question means, but assume that it relates to the slide near the end of the webinar that discusses role changes caused by BPM. Management and executives are most concerned with risk around a project, and they may have concerns that the ROI is too ambitious (either because the new technology fails or too many “soft” ROI factors were used in the calculation) and that the BPM project will fail to meet the promises that they’ve likely made to the layers of management above them. The right choice of ROI metrics can go a long ways to calming their fears, and educating them on the significant benefits of process governance that will result from the implementation of BPM. Management will now have an unprecedented view of the current state and performance of the end-to-end process. They’ll also have more comprehensive departmental performance statistics without manual logging or cutting and pasting from several team reports.

Q: I am a manager in a MNC and I wanted to know how this can help me in my management. How can I use it in my daily management? One example please?

A: By “MNC” I assume that you mean “multi-national corporation”. The answer is no different than from any other type of organization, except that you’re likely to be collaborating with other parts of your organization in other countries hence have the potential to see even greater benefits. One key area for improvement that can be identified with business process modeling, then implemented in a BPMS, is all of the functional redundancy that typically occurs in multi-nationals, particularly those that grow by acquisition. Many functional areas, both administrative/support and line-of-business, will be repeated in multiple locations, for no better reason than that it wasn’t possible to combine them before technology was brought to bear on it. Process modeling will allow you to identify areas that have the potential to be combined across different geographies, and BPM technology allows processes to flow seamlessly from one location to another.

Q: How much detail is allowed in a process diagram (such as the name of the supplier used in a purchase order process or if the manager should be notified via email or SMS to approve a loan)? Is process visibility preferred compared to good classic technical design, in the BPM world?

A: A placeholder for the name of a supplier would certainly be modeled using a property of the process, as would any other custom data elements. As for the channel used for notifying the manager, that might be something that the manager can select himself (optimally) rather than having that fixed by the process; I would consider that to be more of an implementation detail although it could be included in the process model.

I find your second question interesting, because it implies that there’s somehow a conflict between good design and process visibility. Good design starts with the high-level process functional design, which is the job of the analyst who’s doing the process modeling; this person needs to have analytical and design skills even though it’s unlikely that they do technical design or write code. Process visibility usually refers to the ability of people to see what’s happening within executing processes, which would definitely be the result of a good design, as opposed to something that has to be traded off against good design. I might be missing the point of your question, feel free to add a comment to clarify.

Q: Are there any frameworks to develop a BPM solution?

A: Typically, the use of a BPMS implies (or imposes) a framework of sorts on your BPM implementation. For example, you’re using their modeling tool to draw out your process map, which creates all the underpinnings of the executable process without you writing any code to do so. Similarly, you typically use a graphical mapping functionality to map the process parameters onto web services parameters, which in turn creates the technical linkages. Since you’re working in a near-zero-code environment, there’s no real technical framework involved beyond the BPMS itself. I have seen cases where misguided systems integrators create large “frameworks” — actually custom solutions that always require a great deal of additional customization — on top of a BPMS that tends to demote the BPMS to a simple queuing system. Not recommended.

There were also a few questions specifically about TIBCO, for which Emily Burns (TIBCO’s marketing manager, who moderated the webinar) provided answers:

Q: Is TIBCO Studio compatible with Windows Vista?

A: No, Vista is not yet supported.

Q: Are there some examples of ROI from the industry verticals

A: On TIBCO’s web site, there are a variety of case studies that discuss ROI here: http://www.tibco.com/solutions/bpm/customers.jsp. Additionally, these are broken down into some of the major verticals here: http://www.tibco.com/solutions/bpm/bpm_your_industry.jsp

Q: Is there any kind of repository or library of “typical” process? I’m particularly interested in clinical trials.

A: TIBCO’s modeling product ships with a large variety of sample processes aggregated by industry.

And lastly, my own personal favorite question and answer, answered by Emily:

Q: What’s the TLA for BPM+SOA?

A: RAD :)

IQPC BPM Summit: Manish Mehta

Manish Mehta, a project manager at the government of the Region of Peel (which covers a huge chunk of the bedroom communities north and west of Toronto, about 1.2 million people in urban and rural areas), gave a presentation on implementing process management at Peel.

For them, process management was part of their quality management, which already included ISO and some other quality programs. They wanted to strengthen corporate thinking, reduce their silo departmental focus, increase alignment and connection, and measure employee and client satisfaction.

The steps in their process management project were as follows:

  • Phase 1: develop standard terms, definitions and symbols
  • Phase 2: provide process management training, and develop a process management framework
  • Phase 3: develop their service improvement initiative (SII) to apply process management

As with the previous OPG talk, this was not about a BPM implementation, but about putting standard, optimized processes into place in an organization in order to not only improve service delivery, but measure it as well. Specifically, their three goals were to implement process management across the organization, to implement a consistent approach to client satisfaction measurement and management, and to develop and monitor a corporate client satisfaction rating.

They first applied this to their TransHelp program, which provides transportation for those who are unable to use public transportation, then to their waste management program; in both cases, they found that doing client satisfaction surveys identified factors that clients found important that had not been considered by the inside workers: definitely a good reason to get out there and talk to people rather than sitting in the ivory tower and deciding the best process to implement. They are seeing some measurable improvements: with TransHelp, their no-show/cancel rate has dropped in half, and with waste management, their number of complaints has dropped. For process improvement work that they did with children’s services within their financial assistance area, the time to complete an application and assess eligibility dropped dramatically with the new process. Once they’d done these three pilots, they found that other areas started to come to them to ask for help in process improvement: you really need to show some successes in order to get started in a diverse organization such as a regional government. Measuring client satisfaction for regional governments is still in an early stage, and Mehta said that they were working with other government organizations to develop methods for doing this. He also showed a great public sector reference model that linked resources, processes, services and programs and how they interact with providers and clients.

They used outside facilitation for process redesign, but mostly created their own methodology and guidelines and do have some capacity for the process redesign internally. They’ve developed a fairly structured project management approach in terms of defining scope and schedules. They have discovered, not surprisingly, is that pulling subject matter experts away from their regular jobs for several days in order to do the process redesign is much more effective than trying to have people add this on to their real jobs, in spite of the grumbling that will inevitably occur when you try to get a group of people to a multi-day offsite meeting.

Something I really like about what they’ve done is to split their SII approach into three stages, depending on the state and complexity of the original process: repair (quick fixes to smaller broken processes through understanding customer needs), improvement (considering root cause analysis and piloting a solution), and design/redesign (similar to improvement but with best practices and benchmarks). They see both improvement and redesign projects as requiring a trained facilitator.

Mehta showed some private sector studies that showed that employee satisfaction leads to client satisfaction, which in turn provides even greater employee satisfaction, and client satisfaction also leads to greater profitability. Applied to the public sector, you can replace the profitability part of the equation with trust and confidence: greater customer satisfaction results in more trust in the government body and their ability to execute works on behalf of the citizens.

Off to lunch, then I’m up at the front of the room after that.

TIBCO webinar today

I’ll be presenting on a webinar today at noon (Eastern) sponsored by TIBCO, the first in a series of three webinars covering process discovery, process modeling and process design. It’s not too late to sign up if you want to join in.

From their description of today’s webinar:

Join analyst and blogger Sandy Kemsley for an in-depth look at process discovery. Sandy will discuss drivers for process improvement and provide how-to information to addressing:

  • Analyzing current processes and doing walkthroughs
  • Identifying opportunities for process improvement and automation
  • Moving from a functional viewpoint to a business process viewpoint
  • Discovering “hidden” processes in emails and manual procedures
  • Process prototyping

I spoke briefly at the TUCON conference earlier this year on a related subject, “Modeling for the Masses”, and you can see my presentation from that conference below in SlideShare:

Task and Process Exploration and Modelling at I-KNOW ‘07

From Markus Strohmaier of the Know-Center Graz, information on this September’s I-KNOW (International Conference on Knowledge Management), including a special track on Task and Process Exploration and Modelling with the following objectives:

In contrast to the well researched and applied top-down approaches to business process modelling and management the “Task and Process Exploration and Modelling (TPEM)” tries to find answers to the following guiding research questions:

  • To what extend is knowledge work capturing possible? Barriers? Challenges?
  • Can knowledge work be modelled or derived from usage data? Do knowledge work patterns exist and how can they be automatically discovered?
  • What is the impact of usage data analysis on knowledge work support and business process modelling and management?

I’ve been seeing some interesting things with BPM vendors lately about deriving process patterns from usage data, both for the purposes of automating decisions and to suggest decisions to a human operator; there’s a lot of interesting research going on in this area, and some is starting to manifest already. Deadline to submit a paper is May 21st.

Markus is a Column 2 reader who I met face-to-face when he moved to Toronto last year for post-doctoral research; he’s now headed home to Austria.

BEAParticipate: Advanced Process Modelling

Last session of the morning was Mateo Almenta Recca of BEA and Kunal Shah of Citigroup talking about advanced process modelling — specifically process exceptions — in ALBPM. Exceptions can be either system exceptions, such as a service being unavailable, or business (user-defined) exceptions, such as an account being closed. System exceptions are typically handled through automated retries and/or transaction rollbacks, whereas business exceptions are modelled into the process by the process designer.

Exception handlers can be built into the process at either the individual activity, group (similar to a BPMN transaction) or process level. Exception handlers at an activity appear just as an alternative path out of that activity, although an exception is typically invoked by a timeout or other non-decision activity instead of an explicit decision at that point. Exception handlers at the group level are shown connected to the group wrapper boundary, as in BPMN transaction exceptions, and process exception handlers are visualized as disconnected from the process but on the same model.

All exception handlers can take one of three basic actions: abort the process and go to the end of the process, go back and retry the step that threw the exception, or skip the step that threw the exception and move on to the next step in the process. The back and skip functionality is always at the activity level: an exception at the group level that causes a “back” instruction from the exception handler would return to the specific activity to be retried, not the entire group; “skip” would skip the activity but continue on to any later activities in the same group. This was counter-intuitive for me and I asked specifically about that: I would have expected that a group would be treated more like a BPMN transaction wrapper, such that a retry or skip would apply to the entire group, not the specific activity. Exception handlers can be automatic or manual steps: an automatic exception handler might perform some related transaction rollback in another system before aborting a process, for example, whereas a manual exception handler might allow for data repair before retrying the failed step.

They then talked about compensation flows, which seems to match the BPMN meaning of a compensation, in that it reverses a completed activity or group of activities. This isn’t so easy as just rolling back any changed data values in the process instance, since there may have been external systems updated that now need to be rolled back to an earlier state, or non-transactional activities such as sending an email. Compensation flows are used when you can’t use automatic rollback because an activity executed successfully, but can also be called by exception handlers. Visually, these appear very similar on the process model to exception handlers, in that they can be attached at the activity, group or process level. Since groups can be nested in a process model, the compensation flow for a group will invoke the compensation flows for any groups nested within it as it rolls back the entire flow of the group.

They finished up with a short Citigroup case study on how they handle trade exceptions in their back-office processes. Although most financial trades are handled straight through with no manual intervention, they handle 2000 trade exceptions each day. From designing a number of similar transactional BPM implementations, I know that there’s huge financial risk if you don’t handle your exceptions in a timely manner: market fluctuations that occur after the trade is accepted and priced but before it’s completed are purely the risk of the financial institution, not the customer, so it’s key to get the exceptions resolved as quickly as possible. Citigroup has implemented this as process-level exception handlers that log the exceptions and pass them on for manual review. In most cases, the exception handling process is just a matter of some manual data repair and the trade is resubmitted to the automated process, although some trades are cancelled from within the exception handler.

TUCON: Me and Tim Stephenson

In the last session of the day, hence the only thing standing between the attendees and the bar, Tim and I gave a talk on business process modelling. My portion of the talk, which was not at all TIBCO-specific, talked about modelling for the masses; I’ll publish it here when I get a chance. Tim followed on with information about the new release of Business Studio, and how it’s used for process modelling. Tim and I met via email about a month ago when we were getting this all set up, and on Sunday we finally had a chance to meet face-to-face. In spite of our short time together, we’re pretty aligned on most of the issues, so had some pretty good synergy in our talk.

I feel sorry for Tim, as I do for anyone who presents after me, since I tend to get really carried away with what I’m talking about, and I went over my 20-minute allotment of our 40-minute presentation. 10 minutes over. I had a great time, however. :)

Tim went into many of the details of process modelling in the TIBCO Business Studio environment, and showed some particular BPMN examples that can be tricky to understand, such as gateways and events. It looks like they’ve done some nice work of creating process fragments — design patterns for portions of a process — that can be easily inserted in at any point in a process to save time. He also discussed their concept modeller for business domain modelling, allowing you to create an enterprise common object model using formal UML notation. He also had to shore up the damage that I did by slamming the lack of round-tripping by most BPA and BPM vendors.

That’s it for today; we’re all off for drinks at the evening reception, then I have dinner with some of the product marketing team which will give me a chance to pump them for information about what’s coming up.

Tomorrow promises to be interesting — the BPM track is packed with winners, so I’ll be stuck in this same room with the crappy wifi all day, but promise to emerge occasionally and publish what I’ve written.

ProVision 6.0 release

I finally made it home from Chicago around 1:30 this morning: United Airlines wimped out and cancelled all their flights, but Air Canada came through in the crunch.

I’m now on a Proforma webinar about their new V6.0 release of ProVision, of which I had a brief preview at their user conference last fall. Some highlights:

  • Browser-based access for collaboration, although I suspect that this does not include full modelling capabilities based on the comments that I heard at the user conference.
  • Web services access to Knowledge Exchange — this is pretty exciting, and I’d like to hear about more of this. For example, if ProVision exposed process models via a web service, could a BPMS consume that model directly?
  • Embedded Crystal Report functionality, which I recall was a big deal for the user conference attendees.
  • Updated UI in their desktop application, which was looking a bit dated.
  • The concept of dimensions in models, which allows for alternative versions to be created based on specific dimensions, where a dimension may be, for example, geography, or as-is versus to-be. In one model, then, you can compare North American as-is models with European to-be models, or whatever else you want to define based on your dimensions. Pretty powerful stuff.

I’m not familiar enough with ProVision to tell exactly what’s new and what was there before, but it does look like some significant improvements in this version.

ProVision 6.0 is being released over the next two weeks. A replay of the webinar will be available on their website.

BrainStorm BPM Day 2: Dan Madison

Last session of the day for me: I’m headed off to the airport following this, although I realize that the probability of a flight in or out of Chicago being on time when it’s snowing is near zero. With some luck, I’ll make it home tonight. The only thing that I’m missing is some sessions where the vendors get to show off their products, and a final wrapup keynote.

This session by Dan Madison is on Creating the “To Be” Process, something that I often do with customers, and I’m always looking to learn new tips and techniques from others who do the same thing. This session is part of the Organizational Performance symposium, the first of those that I’ve attended these two days.

He suggests a number of “lenses of analysis” to look at processes and derive the “to be” processes from the problems seen in that process.

First, create a customer report card, which for each ranked criteria, shows the current process performance (usually around quality and timeliness), what the best possible performance in that process would look like, and the two main competitors or outsourcers.

Second, look at the things that frustrate the people who are currently participating in the process, since there’s a high correlation between frustration and quality problems: frustration has the ability to act as a lens focussed on problem areas. Once frustrations are identified, the process participants tend to generate a ton of ideas on how to fix the problems, and there’s a huge amount of buy-in for changing the process from the grassroots level. I’ve definitely seen this with my customers. There was an audience question about how to keep this from becoming a bitch session, and Dan said that he uses some basic rules if things start to go that way: only process problems are discussed, not people problems; and each person can only bring forward their three main frustrations.

Third, look at the time required for each type of work in the process: processing, waiting, rework, moving, inspecting and setup. He finds that processing — the actual work — is typically only 2-20% of the time, which indicates that there’s a huge amount of inefficiency in the process. Of that small percentage, even all of that may not be time that adds value to the process. If you’ve automated your process with BPM, then you can gather this information with your system, but if your processes are still manual, then figuring out how your process breaks down will be manual, too.

Fourth, a cost lens such as activity-based costing; ABC calculates what it really costs to deliver a specific product or service by looking at the labour, overhead and material costs of each step in a process.

Fifth, a quality lens such as Six Sigma for measuring defect rates or some other relevant quality measure.

Last, take a look at benchmarks and best practices, by looking at your direct competitors and what they’re doing; and by looking at companies that have a process similar to your problem process and are considered to be world class, regardless of their industry.

He then moved on to design principles for the to-be process:

  • Design the process around value-adding activities.
  • Provide a single point of contact for customers and suppliers.
  • If the inputs coming in to the process naturally cluster, create a separate process for each cluster.
  • Ensure a continuous flow of the “main sequence.”
  • Bring downstream information needs upstream.
  • Involve as few people as possible in performing a process [our old adage of reducing handoffs lives!].
  • Ensure 100% quality at the beginning of the process.
  • Use co-located or networked teams for complex issues.
  • Redesign the process first, and then automate it.

Putting it all together, creating the to-be is the synthesis of:

  • Customer feedback
  • Worker frustrations
  • Time analysis
  • Cost analysis
  • Quality analysis
  • Benchmarking and best practices
  • Design principles
  • Information technology

Dan’s obviously experienced at this: he does it as a consultant, he teaches process mapping and improvement at the local university, and he has a couple of books that he’s written on it. I haven’t read his books, but I’ll be checking them out soon.

BrainStorm BPM Day 2: Ken Orr

For the first breakout session of the day, I attended Ken Orr’s talk on Business Process Driven Enterprise Architecture. He started out with some observations: improving business processes is essential for enterprises; business architecture is critical; modelling is critical; and business processes are hard to manage in the real world and especially in big organizations. Nothing earth-shattering here, but excellent points.

He made a great analogy by talking about IT levees — fragile yet critical applications and systems where you know that they’re a weak point but just never find the time or money to fix them — and understanding when they’re going to break. Apparently, a year before Hurricane Katrina, there was an exercise that modelled exactly what would happen if a force 4 or 5 hurricane hit New Orleans, but nothing was done; when Katrina hit, the levees failed exactly as modelled. Orr talked about mission critical spreadsheets as being one class of IT levees that are all set up to fail at the wrong time.

He talked about how enterprise architecture is like city planning, where your deliverables are things like a city plan, a zoning plan, a building code and an approved building-materials list. Sticking with the disaster analogies, he talked about how building codes are the result of disasters, and the obvious analogy with software and system disasters is pretty clear.

He covered off their enterprise architecture framework briefly, but used it mostly to discuss how the different layers in a framework interact: in short, technology changes enable business changes, and business changes drive the need for technology changes. He also talked about determining what type of business that you’re in, that is, what business processes are you really doing, so that you can figure out whether or not you should be in those businesses as well as how to improve them. Funnily enough, he really answered part of the question that I asked in the panel in the previous session with respect to getting an end-to-end business process view, but that’s sort of expected from an enterprise architecture person since EA can be a key tool in doing just that. In his terminology, what I’m talking about is a value stream, defined by James Martin in The Great Transition as “…an end-to-end set of activities which collectively create value for a customer.”

Update: I forgot to add “Orr’s rules of modelling”, which he gave after I had shut down my laptop, so were just scribbled on a piece of paper:

  1. It’s more important to be clear than correct. If you’re clearly wrong, someone will correct you. If you’re obscurely correct, you may never know.
  2. It’s not important that your first model is correct, only that your last model is correct.

Microsoft and IDS Scheer partner for process modelling

Vendor announcements are dropping from the trees around here this week, but I found this one particularly interesting after my trip to the IDS Scheer user conference a few weeks ago: Microsoft has selected IDS Scheer as a preferred business process modelling/monitoring partner in the newly-formed Business Process Alliance. Now, before you get too excited, the press release says “a” preferred partner, not “the one and only”, implying that other business process modelling and monitoring companies might also be invited to the dance; right now, the Alliance lists AmberPoint, Ascentn, Fair Isaac, Global 360, InRule, Metastorm, PNMsoft, RuleBurst and K2.net as members, so no other modelling but lots of competing business rules and BPM vendors. (By the way, Microsoft’s incorrect use of “is comprised of” on their page — sloppy editing.)

There’s a real-world example of the ARIS UML Designer (now part of ARIS SOA Architect) being used to model business processes for execution in BizTalk at Siemens IT Operations over the past 2 years, so this is built on a pretty strong success story. This provides BizTalk with a fully functional process designer, which was not a strong suit of theirs in the past.

It’s not clear to me whether this is anything beyond a co-marketing campaign; presumably, the existing BPEL export from ARIS would serve for import into BizTalk, or IDS Scheer may choose to do a closer “standards-based” (but not standard) integration such as they have done with SAP and Oracle.

I have to say, however, that I had strong negative feelings about the term Alliance since I first watched the TV series Firefly: they’re the authoritarian bad guys, right? Or maybe they only look bad from the little guy’s viewpoint. :)