 










              Digital's Transaction Processing Monitors


              By Thomas G. Speer and Mark W. Storm



          Abstract                               monitors will be their
              Digital provides two               different application
             transaction processing              programming interfaces.

             (TP) monitor products-              Introduction
             ACMS (Application Control            Transaction processing
             and Management System)              is the execution of
             and DECintact (Integrated           an application that
             Application Control).               performs an administrative
             Each monitor is a unified           function by accessing a
             set of transaction                  shared database. Within
             processing services for the         transaction processing,
             application environment.            processing monitors
             These services are layered          provide the software "glue"
             on the VMS operating                that ties together many
             system. Although there              software components into
             is a large functional               a transaction processing
             overlap between the two,            system solution.
             both products achieve
             similar goals by means               A typical transaction
             of some significantly               processing application
             different implementation            involves interaction with
             strategies. Flow control            many terminal users by
             and multithreading in the           means of a presentation
             ACMS monitor is managed             manager or forms system
             by means of a fourth-               to collect user requests.
             generation language                 Information gathered by
             (4GL) task definition               the presentation manager
             language. Flow control              is then used to query
             and multithreading in               or update one or more
             the DECintact monitor is            databases that reflect
             managed at the application          the current state of the
             level by third-generation           business. A characteristic
             language (3GL) calls to a           of transaction processing
             library of services. The            systems and applications
             ACMS monitor supports a             is many users performing
             deferred task model of              a small number of similar
             queuing, and the DECintact          functions against a common
             monitor supports a message-         database. A transaction
             based model. Over time, the         processing monitor is a
             persistent distinguishing           system environment that
             feature between the two             supports the efficient


                          Digital Technical Journal Vol. 3 No. 1 Winter 1991  1

 


           Digital's Transaction Processing Monitors



             development, execution,             customers have their own
             and management of such              styles of application
             applications.                       programming. Those that
              Processing monitors are            prefer 4GL styles should be
             usually built on top of             able to build transaction
             or as extensions to the             processing applications
             operating system and other          using Digital's TP monitors
             products such as database           without changing their
             systems and presentation            style. Similarly, those
             services. By so doing,              that prefer 3GL styles
             additional components can           should also be able to
             be integrated into a system         build TP applications
             and can fill "holes" by             using Digital's TP monitors
             providing functions that            without changing their
             are specifically needed             style.

             by transaction processing            The ACMS monitor was
             applications. Some examples         first introduced by
             of these functions are              Digital in 1984. The ACMS
             application control and             monitor addresses the
             management, transaction-            requirements of large,
             processing-specific                 complex transaction
             execution environments,             processing applications
             and transaction-processing-         by making them easier to
             specific programming                develop and manage. The
             interfaces.                         ACMS monitor also creates
              Digital provides two               an efficient execution
             transaction processing              environment for these
             monitors: the Application           applications.

             Control and Management               The DECintact monitor
             System (ACMS) and the               (Integrated Application
             DECintact monitor. Both             Control) was originally
             monitors are built on               developed by a third-
             top of the VMS operating            party vendor. Purchased
             system. Each monitor                and introduced by Digital
             provides a unified set              in 1988, and it has
             of transaction-processing-          been installed in major
             specific services to the            financial institutions and
             application environment,            manufacturing sites. The
             and a large functional              DECintact monitor includes
             overlap exists between              its own presentation
             the services each                   manager, support for
             monitor provides. The               DECforms, a recoverable
             distinguishing factor               queuing subsystem, a
             between the two monitors is         transaction manager, and
             in the area of application          a resource manager that
             programming styles                  provides its own recovery
             and interfaces-fourth-              of RMS (Record Management
             generation language (4GL)           Services) files.
             versus third-generation
             language (3GL). This
             distinction represents
             Digital's recognition that

          2  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



              This paper highlights the          points either to another
             important similarities and          menu or to an application
             differences of the ACMS and         and a task. (Decoupling
             DECintact monitors in terms         menus from the application
             of goals and implementation         allows user menus to be
             strategies.                         independent of how the
             Development Environment             tasks are grouped into
                                                 applications.)
              Transaction processing              In addition to separate
             monitors provide a view of          menu specification
             the transaction processing          and system management
             system for application              characteristics, the
             development. Therefore, the         application logic is broken
             ACMS and DECintact monitors         down into the three logical
             must embody a style of              parts of interactive TP
             program development.                applications:

             ACMS Programming Style              o  Exchange steps support

              A "divide and conquer"                the exchange of data
             approach was used in the               with the end user.
             ACMS monitor. The work                 This exchange is
             typically involved in                  typically accomplished
             developing a TP application            by displaying a form on
             was divided into logically             a terminal screen and
             separate functions                     collecting the input.
             described below. Each of            o  Processing steps perform
             these functions was then               computational processing
             "conquered" by a special               and database or file
             utility or approach.                   I/O through standard

              In the ACMS monitor, an               subroutines. The
             "application" is defined as            subroutines are written
             a collection of selectable             in any language that
             units of work called tasks.            accepts records passed
             A separate application                 by reference.

             definition facility                 o  The task definition
             isolates the system                    language defines the
             management characteristics             flow of control between
             of the application (such as            processing steps and
             resource allocation, file              exchange steps and
             location, and protection)              specifies transaction
             from the logic of the                  demarcation. Work
             application.                           spaces are special

              The specification of                  records that the ACMS
             menus is also decoupled                monitor provides to pass
             from the application.                  data between the task
             A nonprocedural (4GL)                  definition, exchange
             method of defining menu                steps, and processing
             layouts is used in which               steps.

             the layouts are compiled
             into form files and data
             structures to be used at
             run-time. Each menu entry

                          Digital Technical Journal Vol. 3 No. 1 Winter 1991  3

 


           Digital's Transaction Processing Monitors



              A compiler, called the             DECintact monitor. All
             application definition              DECintact services are
             utility (ADU), is                   callable, including most
             implemented in the ACMS             services provided by the
             monitor to compile the task         DECintact utilities. The
             definition language into            DECintact services are as
             binary data structures.             follows:
             The run-time system is              o  A library of
             table-driven, rather than              presentation services
             interpreted, by these                  used for all interaction
             structures.                            with users. The

              Digital is the only vendor            application developer
             that supplies this "divide             includes calls to
             and conquer" solution to               these services for
             building large complex TP              form manipulation and
             applications. We believe               display. Forms are
             this approach-unique                   created with a forms
             in the industry-reduces                editor utility and can
             complexity, thus making                be updated dynamically.
             applications easier to                 Forms are displayed
             produce and to manage.                 by the DECintact
             DECintact Programming Style            terminal manager in
                                                    emulated block mode.
              The approach to application           Device- and terminal-
             development used in the                dependent information
             DECintact monitor provides             is completely separated
             the application developer              from the implementation
             with 3GL control over the              of the application.
             transaction processing              o  The separation of
             services required. This                specification of menus
             approach allows application            from the application.
             prototyping and development            DECintact menus are
             to be done rapidly.                    defined by means of
             Moreover, the application              a menu database and
             can make the most efficient            are compiled into data
             use of monitor services by             structures accessed at
             selecting and controlling              run-time. The menus are
             only those services                    tree-structured. Each
             required for a particular              entry points either
             task.                                  to another menu entry

              In the DECintact monitor,             or to an executable
             an application is defined              application image.
             as one or more programs                The specification of
             written entirely in 3GL                menus is linked to the
             and supported by the VMS               DECintact monitor's
             system. The code written by            security subsystem.
             the application developer              The DECintact terminal
             manages all flow control,              user sees only those
             user interaction, and data             specific menu entries
             manipulation through the               for which the user has
             utilities and service                  been granted access.

             libraries provided by the

          4  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             o  A library of services            3GL are required. Further,
                for the control of file          completed applications can
                and queue operations.            be produced quickly because
                In addition to layered           training time is minimal.
                access to the RMS file
                system, the DECintact         On-line Execution Environment
                monitor supports
                its own hash file                 Transaction processing
                format (a functional             monitors provide an
                analog to single-                execution environment
                keyed indexed files              tailored to the
                in RMS) which provides           characteristics and
                very fast, efficient             needs of transaction
                record retrieval. The            processing applications.
                application developer            This environment generally
                includes calls to                has two aspects: on-
                these services for               line, for interactive
                managing RMS and hash            applications that use
                file I/O operations,             terminals; and off-
                demarcating recovery             line, for noninteractive
                unit boundaries,                 applications that use other
                creating queues, placing         devices.
                data items on queues,             Traditional VMS timesharing
                and removing data items          applications are
                from queues. The queuing         implemented by allocating
                subsystem is typically           one VMS process to each
                an integral part of              terminal user when the
                application design               user logs in to the system.
                and work flow control.           An image activation is
                Application-defined              then done each time the
                DECintact recovery units         terminal user invokes a new
                ensure that RMS, hash,           function. This method is
                and queue operations can         most beneficial in simple
                be committed or aborted          transaction processing
                atomically; that is,             applications that have a
                either all permanent             relatively small number
                effects of the recovery          of users. However, as the
                unit happen, or none             number of users grows or
                happen.                          as the application becomes

              Because of DECintact's 3GL         larger and more complex,
             development environment,            several problem areas may
             application programmers who         arise with this method:
             are accustomed to calling           o  Resource use. As the
             procedure libraries from               number of processes
             standard VMS languages or              grows, more and more
             who are familiar with other            memory is needed to run
             transaction processing                 the system effectively.
             monitors can easily learn
             DECintact's services.
             Application prototypes
             can be produced quickly
             because only skills in


                          Digital Technical Journal Vol. 3 No. 1 Winter 1991  5

 


           Digital's Transaction Processing Monitors



             o  Start-up costs.                  the command process
                Process creation, image          implements the functions
                activation, file opens,          of a request initiator,
                and database binds are           presentation manager, and
                expensive operations             request manager for direct
                in terms of system               requests.) [1] The command
                resources utilized and           process is generally
                time elapsed. These              created at system start-
                operations can degrade           up time, although ACMS
                system performance if            commands allow it to be
                done frequently.                 started at other times. The
             o  Contention. As the               process is multithreaded
                number of users                  through the use of VMS
                simultaneously accessing         asynchronous system traps
                a database or file               (AST). Thus, one command
                grows, contention for            process per node is
                locks also increases.            generally sufficient for
                For many applications,           all terminals handled by
                lock contention is a             that node.

                significant factor in             There are two subcomponents
                throughput.                      of the ACMS monitor within

             o  Processing location.             the command process:

                Single process                   o  System interface, which
                implementations limit               is a set of services for
                distribution options.               submitting work requests

             ACMS On-line Execution                 and for interacting with
              To address the problems               the ACMS application

             listed above, Digital               o  DECforms, Digital's
             implemented a client/server            forms management
             architecture in the ACMS               product, which
             monitor. (Client/server                implements the ANSI
             is also called request                 /ISO Forms Interface
             /response.) The basic                  Management System
             run-time architecture                  (FIMS) that provides the
             consists of three types                presentation server for
             of processes, as shown                 executing the exchange
             in Figure 1: the command               steps

             process, execution
             controller, and procedure
             servers.

              An agent in the ACMS
             monitor is a process that
             submits work requests to
             an application. In the
             ACMS system, the command
             process is a special
             agent responsible for
             interactions with the
             terminal user. (In terms
             of the DECdta architecture,

          6  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



              The command process reads           When the execution
             the menu definition for             controller receives a
             a particular terminal               request from the command
             user and determines which           process, it invokes DECdtm
             menu to display. When the           (Digital Distributed
             terminal user selects a             Transaction Manager)
             particular menu entry,              services to join the
             the command process calls           transaction if the agent
             the ACMS system interface           passes the transaction
             services to submit the              identifier. If the agent
             task. The system interface          does not pass a transaction
             uses logical names from the         identifier, there is no
             VMS system to translate the         transaction to join and a
             application name into the           DECdtm or resource-manager-
             address of the execution            specific transaction is
             controller that represents          started as specified
             that application. The               in the task definition.
             system interface then sends         The execution controller
             a message to the execution          then uses the task index
             controller. The message             to find the tables that
             contains the locations of           represent the task. When
             the presentation server             the execution of a task
             and an index into the               reaches an exchange step,
             task definition tables              the execution controller
             for the particular task.            sends a callback to the
             The status of the task is           command process for a form
             returned in the response.           to be displayed and the
             During the course of task           input to be collected for
             execution, the command              the task. When the request
             process accepts callbacks           to display a form is sent
             from the task to display a          to the command process,
             form for interaction with           the execution controller
             the terminal user.                  dismisses the AST to enable
                                                 other threads to execute.
              The execution controller           When the response to the
             executes the task                   request arrives from the
             definition language                 exchange step, an AST is
             and creates and manages             added to the queue for the
             procedure servers. The              execution controller.
             controller is created at             When a task comes to
             application start-up time           a processing step, the
             and is multithreaded by             execution controller
             using VMS ASTs. There is            allocates a free procedure
             one execution controller            server to the task. It
             per application. (In terms          then sends a request to
             of the DECdta architecture,         the procedure server to
             the execution controller            execute the particular
             and the procedure servers           procedure and dismisses
             implement the functions of          the AST. If no procedure
             a transaction server.) [1]          server is free, the

                                                 execution controller puts
                                                 the request on a waiting


                          Digital Technical Journal Vol. 3 No. 1 Winter 1991  7

 


           Digital's Transaction Processing Monitors



             list and dismisses the AST.          The ACMS architecture
             When a procedure server             addresses the problem
             becomes free, the execution         areas discussed in the On-
             controller checks the wait          line Execution Environment
             list and allocates the              section in several ways.
             procedure server to the              Resource Use. Because
             next task, if any, on the           procedure servers are
             wait list.                          allocated only for the

              Procedure servers are              time required to execute
             created and deleted by              a processing step, the
             the execution controller.           servers are available for
             Procedure servers are a             other use while a terminal
             collection of user-written          user types in data for the
             procedures that perform             form. Thus, the system can
             computation and provide             execute efficiently with
             database or file accesses           fewer procedure servers
             for the application. The            than active terminal
             procedures are written              users. Improvement gains
             in standard languages and           in resource use can
             use no special services.            vary, depending on the
             The ACMS system creates             application. Our debit
             a transfer vector from              and credit benchmark
             the server definition.              experiments with the ACMS
             This transfer vector is             monitor and the Rdb/VMS
             linked into the server              relational database system
             image. With this vector,            indicated that the most
             the ACMS system code can            improvement occurs with one
             receive incoming messages           procedure server for every
             and translate them into             one or two transactions
             calls to the procedure.             per second (TPS). These
              A procedure server                 benchmarks equate to 1
             is specified with                   procedure server for every
             initialization and                  10 to 20 active terminal
             termination procedures,             users.

             which are routines                   The use of procedure
             supplied by the user.               servers and the
             The ACMS monitor calls              multithreaded character
             these procedures whenever           of the execution controller
             a procedure server is               and the command process
             created and deleted. The            allow the architecture
             initialization procedure            to reduce the number of
             opens files and performs            processes and, therefore,
             database bind operations.           the number of resources
             The termination procedure           needed. The optimal
             does clean-up work, such            solution for resource use
             as closing files prior to           would consist of one large
             process exit.                       multithreaded process that
                                                 performed all processing.
                                                 However, we chose to trade
                                                 off some resource use in
                                                 the architecture in favor
                                                 of other gains.

          8  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             o  Ease of use-                      Start-up Costs. The
                Multithreaded                    run-time environment is
                applications are                 basically "static," which
                generally more difficult         means that the start-
                to code than single-             up costs (i.e., system
                threaded applications.           resources and elapsed time)
                For this reason,                 are incurred infrequently
                procedure server                 (i.e., at system and
                subroutines in the ACMS          application start-up time).
                system can be written            A timesharing user who
                in a standard fashion            is running many different
                by using standard calls          applications causes image
                to Rdb/VMS and the VMS           activations and rundowns by
                system.                          switching among images.
             o  Error isolation-In one           Because the terminal
                large multithreaded              user in the ACMS system
                process, the threads are         is separated from the
                not completely protected         applications processes,
                within the process.              the process of switching
                An application logic             applications involves
                error in one thread              only changing message
                can corrupt data in a            destinations and incurs
                thread that is executing         minimal overhead.

                for a different user.             Contention. The database
                A severe error in one            accesses in the ACMS
                thread could potentially         environment are channeled
                bring down the entire            through a relatively few,
                application. The                 but heavily used, number
                multithreaded processes          of processes. The typical
                in the ACMS architecture         VMS timesharing environment
                (i.e., the execution             uses a large number of
                controller and command           lightly used processes.
                process) are provided            By reducing the number of
                by Digital. Because              processes that access the
                no application code              database, the contention
                executes directly                for locks is reduced.
                in these processes,               Processing Location.
                we can guarantee                 Because the ACMS monitor
                that no application              is a multiprocess
                coding error can                 architecture, the
                affect them. Procedure           command process and forms
                servers are single-              processing can be done
                threaded. Therefore,             close to the terminal user
                an application logic             on small, inexpensive
                error in a procedure             machines. This method
                server is isolated to            takes advantage of the
                affect only the task             inexpensive processing
                that is executing in the         power available on these
                procedure server.                smaller machines while the

                                                 rest of the application
                                                 executes on a larger
                                                 VAXcluster system.

                          Digital Technical Journal Vol. 3 No. 1 Winter 1991  9

 


           Digital's Transaction Processing Monitors



             DECintact On-line Execution         consists of three types
                                                 of DECintact system
              Although the specific              processes-terminal manager
             components of the DECintact         /dispatcher, DECforms
             monitor vary from those             servers, server manager-
             of the ACMS monitor, the            and, typically, one or more
             basic architecture is very          application processes.
             similar. Figure 2 shows             When forms processing
             the application configured          is distributed, the same
             locally to the front end.           application is configured
             The run-time architecture           as shown in Figure 3.

              The DECintact monitor can           Applications designated in
             run in multiple copies              the local menu database as
             on any one VAX node. Each           remote applications cause
             copy can be an independent          the front-end terminal
             run-time environment; or            manager/dispatcher process
             it can share data and               to communicate with the
             resources, such as user             cooperating back-end
             security profiles and               terminal manager/dispatcher
             menu definitions, with              process through a task-to-
             other copies on the same            task DECnet link. (In terms
             system. Thus, independent           of the DECdta architecture,
             development, testing, and           the terminal manager
             production environments can         /dispatcher implements the
             reside on the same node.            functions of presentation
              In the DECintact system,           manager, request initiator,
             the terminal manager                and request manager for
             /dispatcher process (one            direct requests.) [1]

             per copy) is responsible             When a user selects the
             for the following:                  remote task, that user's
             o  Displaying DECintact             request is sent to the
                forms                            back end and is treated
                                                 by the application as a
             o  Coordinating DECforms            local request. The terminal
                forms display                    manager/dispatcher process

             o  Interacting with local           is started automatically
                applications                     as part of a copy start-
             o  Communicating, through           up and is multithreaded.
                DECnet, with remote              Therefore, one such process
                DECintact copies                 can handle all the terminal
                                                 users for a particular
             o  Maintaining security             DECintact copy.
                authorization, including          When the terminal user
                the dynamic generation           selects a menu task, one
                of user-specific menus           of the following actions

                                                 occurs, depending on
                                                 whether the task is local
                                                 or remote and whether it is
                                                 single- or multithreaded.


          10  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



              If the application is local        /dispatcher processes the
             and single-threaded, a VMS          selection locally by using
             process may be created that         the same procedures as
             activates the application           described above.
             image associated with this           Local DECintact forms
             task. The terminal manager          interaction is handled
             /dispatcher, upon start up,         in the following manner
             may create a user-specified         by the local terminal
             number of application shell         manager/dispatcher. The
             VMS processes to activate           application's call to
             subsequent application              display a form sends a
             images. If such a shell             request to the terminal
             exists when the user                manager. The terminal
             selects a task, this                manager locates the form
             process is used to run              in its database of active
             the application image. Each         forms, displays the form
             user who selects a given            on the user's terminal,
             menu entry receives an              and returns control to the
             individual VMS process and          application when the user
             image.                              has entered all data in the

              If the application is local        form. If the application
             and multithreaded, the              is remote, form information
             terminal manager/dispatcher         is sent between cooperating
             first determines whether            local and remote terminal
             this task has already               manager processes; the
             been activated by previous          interface is transparent to
             users. If the task has              the application.
             not been activated and a             In addition to supporting
             shell is not available, the         DECintact forms, the
             terminal manager/dispatcher         DECintact monitor also
             creates a VMS process               supports applications
             for the application and             that use DECforms as their
             activates the image. If the         presentation service. The
             task is already activated,          implementation of this
             the terminal manager                support follows the same
             /dispatcher connects the            client/server model used by
             user to the active task.            the ACMS system's support
             The user becomes another            for DECforms and shares
             thread of execution within          much of the underlying
             the image. Multithreaded            run-time interprocess
             applications handle many            communication code used
             simultaneous users within           by the ACMS monitor.
             the context of one VMS              Functionally, the two
             process and image.                  implementations of DECforms

              Remote applications,               support are also similar to
             whether single- or                  the ACMS monitor. Both
             multithreaded, route the            implementations offer
             menu task selection to a            transparent support for
             remote terminal manager             distributed DECforms
             /dispatcher process. On             processing, automatic forms
             receipt of the request,             caching (i.e., propagation
             the remote terminal manager         of updated DECforms in a

                         Digital Technical Journal Vol. 3 No. 1 Winter 1991  11

 


           Digital's Transaction Processing Monitors



             distributed environment),            In a multithreaded on-line
             and DECforms session                application, the following
             caching for increased               occurs:
             performance.                        o  One VMS process/image

              The DECintact monitor                 can handle many
             supports application-level,            simultaneous users.
             single- and multithreaded           o  All terminal and file
             environments. The DECintact            I/O is asynchronous.
             monitor's threading                 o  New threads are created
             package allows application             automatically when new
             programmers to use standard            users are connected to
             languages supported by                 the process.
             the VMS system to write
             multithreaded processes.            o  The application image
             Applications declare                   does not exit when all
             themselves as either                   currently allocated
             single- or multithreaded.              threads have completed
             With the exception of                  execution but remains
             the declaration, there                 for use by new on-line
             is little difference                   users.
             between the way an on-               For each thread in a
             line multithreaded                  multithreaded application
             application and its single-         image, the DECintact system
             threaded counterpart                maintains thread context
             must be coded. For on-              and state information.
             line applications, thread           Each I/O request is issued
             creation, deletion, and             asynchronously. Immediately
             management are automatic.           after control is returned,
             New threads are created             but before the I/O request
             when a terminal user                completes, the DECintact
             selects the multithreaded           system saves the currently
             application and are deleted         executing thread's context
             when the user leaves the            and schedules another
             application.                        thread to execute. When the

              In a single-threaded               thread's I/O completion AST
             application, the following          is delivered, the thread's
             occurs:                             context is restored, and
             o  Each user receives an            the thread is inserted on
                individual VMS process           an internally maintained
                and image context                list of threads eligible
                (e.g., 200 users, 200            for execution.

                processes).                       A thread's context consists
             o  All terminal and file            of the following:

                I/O is synchronous.              o  An internally maintained

             o  The application image               thread block containing
                normally exits when                 state information

                the application work is          o  The stack
                completed.

          12  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             o  Standard DECintact               programs or other batch-
                work spaces that are             oriented processing. These
                allocated to each thread         kinds of applications
                and that maintain                typically choose to declare
                terminal and file                themselves as single-
                management context               threaded.

             o  Local storage (e.g.,              All I/O from within a
                the $LOCAL PSECT in              multithreaded DECintact
                COBOL applications)              application process is
                that the application has         asynchronous. Therefore,
                designated as thread-            the DECintact system
                specific                         provides a client/server

              The PSECT naming convention        interface between
             allows the application              multithreaded applications
             to decide which variable            and synchronous database
             storage is thread-specific          systems, such as VAX DBMS
             and which is process-               (Database Management
             global. Thread-specific             System) and Rdb/VMS
             storage is unavailable              systems. The interface
             to other threads in the             is provided because calling
             same process because it             a synchronous database
             is saved and restored               operation directly from
             on each thread switch.              within a multithreaded
             Process-global storage is           application would stall
             always available to all             the calling thread and all
             threads in the process              other threads until the
             and can be used when                call completed. Figure 2
             interthread communication           shows that a typical on-
             or synchronization is               line DECintact application
             desired.                            accessing Rdb/VMS, for
                                                 example, is written in two
              The use of multithreading          pieces:
             in the DECintact system             o  A multithreaded, on-line
             is appropriate for                     piece (the client), that
             higher volume multiuser                handles forms requests
             applications that perform              from multiple users
             frequent I/O. Such
             application usage is                o  A single-threaded,
             typical in transaction                 database server piece
             processing environments.               (a server instance),
             Because thread switches                that performs the actual
             occur only when I/O is                 synchronous database I/O
             requested or when locking            This client/server approach
             requests are issued,                to database access is
             this environment may                functionally very similar
             not be recommended for              to that of ACMS procedure
             applications that perform           servers and offers similar
             infrequent I/O or that              benefits. Like the ACMS
             expect very small numbers           monitor, the DECintact
             of concurrent users, such           monitor offers system
             as end-of-day accounting            management facilities to

                                                 define pools of servers

                         Digital Technical Journal Vol. 3 No. 1 Winter 1991  13

 


           Digital's Transaction Processing Monitors



             and to adjust them                   Resource Use. The DECintact
             dynamically at run-time             system's multithreaded
             in accordance with load.            methodology economizes
             Similar algorithms are              on VMS resources. Similar
             used in both monitors to            to the method used in the
             allocate server instances           ACMS monitor, the system
             to client threads and to            reduces process creations
             start up new instances, as          and image activations. A
             necessary. The DECintact            major difference between
             server code, like the ACMS          the ACMS and DECintact
             procedure server code, can          architectures is the way
             define initialization and           the DECintact monitor
             termination procedures to           implements multithreading
             perform once-only start-up          support. The transparent
             and shut-down processing.           implementation of threading
             With DECintact transaction          capabilities means that
             semantics, which are                coding multithreaded
             layered on DECdtm services,         applications is no more
             a client can declare a              difficult than coding
             global transaction that             traditional single-threaded
             the server instance will            applications. As with
             join. The server instance           any application-level
             can also declare its own            threading scheme, however,
             independent transaction or          the responsibility for
             no transaction. (In terms           ensuring that a logic
             of the DECdta architecture,         error in one thread is
             this client/server approach         isolated to that thread
             implements the functions of         lies with the application.
             a transaction server.) [1]          The DECintact client/server
             The principal difference            facilities for accessing
             between the DECintact and           databases, like those used
             ACMS approach is that               in the ACMS monitor, can
             DECintact clients and               realize similar benefits in
             servers use a message-              process reuse, throughput,
             based 3GL communications            and error isolation.
             interface to send and                Start-up Costs. The
             receive work requests.              DECintact architecture,
             Control in the ACMS monitor         like the ACMS architecture,
             resides in the execution            distributes start-up
             controller.                         costs (i.e., system

              As the ACMS monitor does,          resources and elapsed time)
             the DECintact architecture          between two points: the
             addresses the problem               start of the DECintact
             areas discussed in the              system, and the start of
             On-line Execution section           applications. System start-
             in several ways. Also, as           up can involve prestarting
             with the ACMS approach,             VMS process shells (as
             the factors we chose to             discussed previously) for
             trade off allowed us to             subsequent application
             achieve better efficiency,          image activation. On-line
             performance, and ease of            application start-up is
             use.                                executed on demand when


          14  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             the first user selects              requirements that differ
             a particular menu task.             from the requirements of
             Multithreaded applications,         interactive applications:
             once started, do not exit           tasks must be simple data
             but wait for new user               entries, and the system
             threads as users select             must handle failures
             the application. Thus,              transparently.
             the DECintact terminal              ACMS Off-line Execution
             user can switch between
             application images and               The ACMS monitor's goal for
             incur only an inexpensive           off-line processing is to
             thread creation.                    allow simple transaction
              Contention. As in the              capture to continue when
             ACMS monitor, database              the application is not
             accesses in the DECintact           available. A typical
             client/server environment           example is the continued
             are channeled through a             capture of data on a
             relatively few, but heavily         manufacturing assembly
             used, number of processes           line by a MicroVAX system
             rather than through a large         when the application is
             number of lightly used              unavailable. The ACMS
             processes. This reduction           monitor provides two
             decreases lock contention.          mechanisms for supporting
                                                 nonterminal devices:
              Processing Location. Forms         queuing agents and user-
             processing can be off-              written agents.
             loaded to a front end                Figure 4 illustrates
             and brought closer to               the ACMS queuing model.
             the terminal user. Thus             A queuing system is a
             smaller, less expensive             resource manager that
             CPUs can be used while the          processes entries, with
             rest of the application             priorities, in first-in,
             executes on a larger back-          first-out (FIFO) order.
             end machine or cluster. In          (In terms of DECdta, this
             the DECintact monitor, the          is the queue resource
             front end can consist of            manager.) [1] The ACMS
             forms processing only or a          queuing facility is built
             mix of forms processing and         upon RMS-indexed files.
             application remote queuing          The primary goal of ACMS
             work.                               queuing is to provide a

                                                 store-and-forward mechanism
          Off-line Execution                     to allow task requests
              Many transaction processing        to be collected for later
             applications are used with          execution. By using the
             nonterminal devices, such           ACMS$ENQUE_TASK service, a
             as a bar code reader or             user can write a process
             a communications link               that captures a task
             used for an electronic              request and safely stores
             funds transfer application.         the task on a local disk
             Because there is no human           queue.

             interaction with these
             applications, they have two

                         Digital Technical Journal Vol. 3 No. 1 Winter 1991  15

 


           Digital's Transaction Processing Monitors



              The ACMS monitor provides          completes, the agent
             a special agent, called             commits the transaction.
             the queued task initiator           If DECdtm returns an
             (QTI), which takes a task           error on the commit, the
             entry from the queue                agent loops back to start
             and submits it to the               another transaction and
             appropriate execution               to resubmit the task. If
             controller. The QTI starts          a VAXcluster system is
             a DECdtm transaction,               used for the application,
             removes the task entry              this configuration will
             from the queue within               survive any single point of
             that transaction, invokes           failure.

             the ACMS task, and                  DECintact Off-line
             passes the transaction              Execution
             identifier. (In the DECdta           The DECintact monitor
             architecture, the QTI               provides several facilities
             implements the functions            for applications to perform
             of a request manager for            off-line processing.
             queued requests.) [1]               These facilities allow
             The task then joins that            applications to
             transaction. The removal
             from the queue is atomic            o  Interface with and
             with the commit of the                 process data from
             task, and no task entry is             nonterminal devices and
             lost or executed twice.                asynchronous events

              Figure 5 shows the ACMS            o  Control transaction
             user-written agent model               capture, store and
             for off-line processing.               forward, interprocess
             With the ACMS system                   communication, and
             interface, users may write             business work flow
             their own versions of the              through the DECintact
             command process. Note that             queuing subsystem

             because these agents cannot          Off-line Multithreading.
             be safely stored on disks,          Off-line, multithreaded
             this method is generally            DECintact applications
             not as reliable as using            are typically used to
             queues. User-written agents         service asynchronous
             can be used, however,               events, such as the arrival
             with DECdtm and the fault-          of an electronic funds
             tolerant VAXft 3000 system          transfer message or the
             to produce a reliable               addition to the queue
             front-end system. To do             of an item already on
             so, a user writes an agent          a DECintact queue. The
             that captures the input for         application programmer
             the task and then starts a          explicitly controls how
             DECdtm transaction. The             many threads are created,
             agent uses the system               when they are created,
             interface services to               and which execution path
             invoke the ACMS task and            or paths each thread
             passes the transaction              will follow. Off-line,
             identifier and the input            multithreaded applications
             data. When the task call

          16  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             are well-suited to message          application: from the front
             switching systems and other         end, where queues collect
             aspects of electronic funds         and route incoming data;
             transfer in which each              to the back end, where
             thread may be dedicated to          queues can be integrated
             servicing a different kind          with data files in recovery
             of event.                           units; and in between,
              DECintact Queues. The              where different programs
             primary goal of the                 in the application can use
             DECintact queuing subsystem         queues to share data.

             is to support a work                 The DECintact queuing
             flow model of business              subsystem consists of
             transactions. (In the               a comprehensive set of
             DECdta architecture, the            callable services for the
             DECintact queuing subsystem         creation and manipulation
             implements the functions of         of queues, queue sets,
             a queue resource manager            and queue items. Queue
             and request initiator               item operations performed
             for queued requests.) [1]           within the context of a
             In a typical DECintact              DECintact transaction are
             application that relies             fully atomic along with
             on queuing, the state of            DECintact file operations.
             the business transaction             In addition to overall
             may be represented by the           workflow control, the
             queue on which a particular         DECintact queuing system
             queue item resides at the           allows the following:
             moment. An item moves from
             queue to queue as the               o  Deferred processing-An
             item's processing state                item can be queued by
             changes, much as a work                one process and then
             item moves from desk to                removed from the queue
             desk. The superset of                  later by another process
             queue items that reside                for processing. Deferred
             on queues throughout the               processing is useful
             application at any one                 when the volume of data
             time represents the state              entry is concentrated at
             of transactions currently              particular times of day;
             executing. Depending on                applications can assign
             the number of programs                 themselves to one or
             that need to process data              more queues and can be
             during the course of a                 notified when an item is
             transaction, a queue item              inserted on the queue.
             may be inserted on several          o  Store-and-forward
             different queues before the            processing-When users
             transaction completes. The             at the front end of
             application also may wish              the system write items
             to chain together several              to local queues, data
             small transactions within              entry can be continuous
             the context of a larger                in the event of back-
             business transaction. The              end system failure or
             DECintact queuing system               whenever a program that
             functions throughout the               is needed to process


                         Digital Technical Journal Vol. 3 No. 1 Winter 1991  17

 


           Digital's Transaction Processing Monitors



                data is temporarily              items can be held against
                unavailable.                     removal or released. Queues
             o  Interprocess                     can be grouped together
                communication-Locally            into logical entities,
                between applications             called queue sets, which
                sharing a node and by            look and behave to the
                means of the DECintact           application the same as
                remote queuing facility,         individual queues. Queue
                applications can use             sets have added facilities
                the queuing system               for broadcast insertion on
                to reliably exchange             all members of a queue set
                application data                 and a choice of removing
                between processes and            algorithms that can weight
                applications.                    relative item- and queue-
                                                 level priorities from the
              A fundamental difference           queue.
             between ACMS queues and              DECintact queues can be
             DECintact queues is that            automatically distributed.
             the ACMS system inserts             At the system management
             tasks onto the queues,              level, a local queue
             and the DECintact system            can be designated as
             inserts data items. In              remote outbound. That is
             DECintact queuing, each             to say, items added to
             data item contains both             this queue are shipped
             user-supplied data and a            transparently across the
             header that includes an             network to a corresponding
             item key and other control          remote inbound queue on
             information. The header is          the destination node. The
             used by the queuing system          transfer is handled by the
             to control the movement             DECintact queuing system
             of the item from queue              by using exactly-once
             to queue. Each queue item           semantics (i.e., the item
             can be assigned an item             is guaranteed to be sent
             priority. Items can be              once and only once). From
             removed from the queue in           the point of view of the
             FIFO order, in FIFO order           application that is adding
             within item priority, or            or removing items from the
             by direct access using the          queue, remote queues behave
             item key. Queues can be             exactly as local queues
             stopped and started for             behave.
             insertion, removal, or
             both. Queues can also be             To better understand
             redirected transparently at         some of the uses for
             the system management level         DECintact queuing,
             to running applications.            consider a simplified but

              In the DECintact monitor,          representative electronic
             alert thresholds can be             funds transfer example
             specified on a queue-               built on the DECintact
             by-queue basis to alert             monitor. Figure 6 shows
             the system manager when             the elements of such
             queue levels reach defined          an application. In this
             amounts. Individual queue           application, transactions
                                                 might be initiated either

          18  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             locally by clerks entering           To implement this
             data into the system from           application, the developer
             user-generated documents or         uses queues to route,
             by an off-line application          safely store, and
             that receives data from             synchronize data as it
             another branch or bank.             progresses through the
             The transactions are                system, and to prioritize
             verified or repaired by             data items. Data items are
             other clerks in a different         given priority levels,
             department of the bank.             based on application-
             The transactions are then           defined criteria, such
             sent to destination banks           as transfer amount,
             over one or more network            destination bank, or time-
             services.                           to-closing.

              As illustrated in Figure           means of database server
             6, the terminal manager             programs.
             controls terminals for the           The Fedwire Xmt queue
             Data Entry and Verify and           could be defined as a
             Repair applications. Clerks         queue set, which would
             enter data from user-               permit the Fedwire Process
             generated documents on-             application to remove
             line as complete messages.          items from the queue by
             Verification and repair             a number of algorithms
             clerks receive these                that bias the transfer
             messages as work items              amount by queue and item
             from the verify and repair          priority. Similarly,
             queue through the Verify            this queue set could be
             and Repair application. The         passively reprioritized
             result of verification is           near the close of the
             either a validated message,         business day. In other
             which is ultimately sent to         words, the DECintact
             a destination bank, or an           system administrator could
             unverifiable message, which         use the DECintact queue
             is routed to the supervisor         utility near the end of
             queue for special handling.         the day to change queue-
             After special handling,             wide priorities and ensure
             the message rejoins                 that items with a higher
             the processing flow by              priority level in the queue
             returning to the verify             set would be sent over
             and repair queue. After             the Fedwire first, without
             validation, the messages            changing any application
             are inserted in the                 code.
             Fedwire Xmt queue and
             sent over the network
             to the Federal Reserve           Application Management
             System. The Fedwire Process          Typically, transaction
             application controls the            processing applications
             physical interface to the           are crucial to the business
             communication line and              running the applications.
             implements the Fedwire              If the applications cannot
             protocol. The validated             perform their functions
             messages are also used to           reliably or securely,
             update a local database by

                         Digital Technical Journal Vol. 3 No. 1 Winter 1991  19

 


           Digital's Transaction Processing Monitors



             business activity may               user has login access,
             have to cease altogether            the VMS system cannot
             or be curtailed, as in              be accessed. The user's
             the case of an inventory            access is restricted to
             control application or              only those ACMS functions
             electronic funds processing         that the user is permitted
             application. Therefore,             to invoke. This restriction
             the applications require            prevents a user from
             additional controls                 damaging the integrity
             to ensure that the                  of data on the system.
             applications and the                The ACMS monitor also
             access by users to the              allows access support
             applications are limited to         for terminals that are
             exactly what is needed for          automatically logged in to
             the business.                       the ACMS system, such as a
             ACMS Application Management         terminal on a shop floor.
                                                 Such access is useful
              Of the many features and           for unprivileged users
             tools for monitoring and            who are not accustomed to
             controlling the system              computers. They can enter
             offered in the ACMS                 data without understanding
             monitor, three areas are            the process for logging in
             most often used.                    to the system.

             o  Controlling and                   For application control,
                restricting terminal             the ACMS monitor uses
                user environments                a protected directory,
             o  Controlling and                  ACMS$DIRECTORY, to store
                restricting the                  the application definition
                application                      files. The application
             o  Ability to dynamically           authorization utility
                make changes to the              (AAU) ensures that special
                application without              authorization is required
                stopping work                    for a user to make changes
                                                 to an application.

              In addition to using the            In the ACMS monitor, the
             VMS user authorization              application is a single
             file (VMS SYSUAF), the ACMS         point of control. The ACMS
             monitor provides utilities          /START APPLICATION and
             to define which users and           ACMS/STOP APPLICATION
             terminals have access to            commands cause the
             the ACMS system. Controlled         execution controller for
             terminals are terminals             the application to be
             defined by one of these             created and deleted. An
             utilities to be owned by            operator can control the
             the ACMS monitor. These             times when an application
             terminals are allocated by          is accessible. For example,
             the ACMS monitor when the           an application can be
             ACMS system is started.             controlled to run only
             When a user presses the             on Fridays or only between
             Return key, the ACMS                certain hours. The control
             monitor displays its                of access times can also
             login prompt. Unless the            be used to restrict

          20  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             access while changes or                given DECintact user
             repairs are made to the                name can be signed on to
             application. This type of              the DECintact system at
             access control is difficult            any one time on any one
             to achieve with only the               node.
             VMS system because the VMS          o  Dedicated terminal
             system does not provide                security profiles are
             these capabilities.                    used, in conjunction

              The execution controller              with user security
             does access-control list               profiles, to provide
             checking that is specified             geographic entitlement.

             for each task. This                 o  CAPTIVE and INITIAL_MENU
             mechanism can restrict                 user attributes restrict
             user access by function.               users to a specific menu
             For example, a user could              level of functions and
             have the privilege to                  prevent the user from
             make a particular update               accessing outer levels.
             to a database but not               o  User-specific menus
             have access to read or                 are menu entries for
             make changes to any other              which an explicit
             parts of that database.                authorization has been
             The execution controller               granted in the user
             achieves a much finer                  profile and are the
             level of control than do               only menu items visible
             the mechanisms of the VMS              on the menu presented
             system or the database                 to terminal users. The
             system.                                DECintact monitor does

             DECintact Application                  include an exception
             Management                             for users who have
              The DECintact monitor                 an auditor privilege.
             controls access to the                 Auditors can see all
             whole system and to                    menu functions but
             individual tasks by means              must be specifically
             of a security subsystem.               authorized to execute
             The subsystem adds                     any single function.

             transaction-processing-             o  The subsystem provides
             specific features to basic             the ability to
             VMS security.                          dynamically enable or
             o  User security profiles              disable specific menu
                specify the DECintact               functions.

                user name and password           o  Password revalidation is
                (DECintact users are                an attribute that can be
                not required to have                associated with a menu
                an entry in the VMS                 function. If set, the
                SYSUAF file); levels of             user must reenter the
                security entitlement;               DECintact user name and
                inclusive and exclusive             password before being
                hours of permissible                allowed to access the
                sign-on; menu entries               function.

                authorized for the user.
                Only one user under a

                         Digital Technical Journal Vol. 3 No. 1 Winter 1991  21

 


           Digital's Transaction Processing Monitors



              The DECintact monitor               Normally, if a function
             supports both controlled            is enabled in a user
             or dedicated terminals              profile, the user can
             and terminals assigned              access the function without
             LAT terminal server                 further checks. If the GEOG
             application ports, as               attribute is associated
             does the ACMS monitor.              with the function, however,
             These terminals are owned           that function must be
             by, and allocated to, the           enabled in the user profile
             DECintact system. When a            and in the terminal profile
             user types any character            before it can be accessed.
             at these terminals, a                Geographic entitlement is
             DECintact sign-on screen            frequently a requirement
             is displayed, and the user          in financial environments
             is prevented from logging           which have specific and
             in to the VMS system.               rigid security protocols.

              Geographic entitlement             For example, a bank officer
             limits certain DECintact            may be authorized to
             terminal-based functions to         execute certain sensitive
             certain terminals or even           functions available only
             to certain users on certain         at dedicated terminals
             terminals. The three                when the officer is signed-
             elements in geographic              in at the home office.
             entitlement are as follows:         The same officer may be
             o  The user security                authorized to execute only
                profile enables a                a subset of less sensitive
                function to be accessed          functions when signed-in
                by a certain user.               from a branch office. Such
                                                 sensitive functions can be
             o  The terminal security            protected by requiring that
                profile enables a                the user profile and the
                function to be accessed          dedicated terminal profile
                at a certain terminal.           enable the function.

             o  A GEOG attribute is               Applications and resources
                associated with a menu           are controlled within the
                entry in the terminal            context of a DECintact
                manager/dispatcher's             copy's run-time and
                menu database. This              management environment.
                attribute, when                  Multiple copies can be
                associated with a                established on the same
                function, demands                VMS system. Different
                that there be an                 groups of users can
                applicable terminal              maintain a certain level
                security profile before          of autonomy (e.g., separate
                the function can be              applications and data
                accessed.                        files), but all users can

                                                 also share some or all
                                                 functions and resources
                                                 of a given DECintact
                                                 version. A typical
                                                 example of this concept,
                                                 that is, the ability to

          22  Digital Technical Journal Vol. 3 No. 1 Winter 1991

 


                                      Digital's Transaction Processing Monitors



             create multiple DECintact           queue set attributes,
             copies for isolation and            and performs all other
             partitioning, is the common         functions necessary for
             practice of establishing            managing the DECintact
             development, acceptance             queuing subsystem.
             testing, and production              In general, the DECintact
             DECintact environments.             monitor's security and
             Managing applications               application control
             and resources within a              focuses on the front end
             development environment,            by concentrating access
             for example, can differ             checking at the point of
             from managing applications          system sign-in and menu
             and resources within a              generation. The ACMS system
             production environment with         concentrates more on the
             a different system manager.         back-end parts of the

              Access to menu functions           system by means of VMS
             is controlled by the                access control lists (ACL)
             INTACT MANAGE DISABLE               on specified tasks. The
             /ENABLE command. This               ACMS approach is built on
             command removes or restores         VMS security and system
             specified functions                 access (the SYSUAF file)
             dynamically from all menus          and reflects an environment
             in the DECintact copy and           in which the VMS system and
             disables or enables their           the transaction processing
             selection by subsequent             security functions are
             users. (Current accessors           typically performed by the
             of the specified function           same system management
             are allowed to complete the         agency. The DECintact
             function.) The execution of         monitor's system access is
             single- and multithreaded           handled more independently
             applications or DECintact           of the VMS system and
             system components can be            reflects an environment
             shut down by the INTACT             in which transaction-
             MANAGE SHUTDOWN command.            processing-specific
             This command issues a               security functions may
             mailbox request to the              be performed by a different
             application or component,           department from those of
             which then initiates an             the general VMS security
             orderly shutdown. Access            system.
             to the system by inclusive
             and exclusive time of day        Conclusion
             is controlled on a per-user
             basis through the DECintact          The ACMS and DECintact
             security subsystem.                 transaction processing
             In addition to these                monitors provide a unified
             commands and functions,             set of transaction-
             the queuing subsystem               processing-specific
             is managed by means of a            services to the application
             queue management utility.           environment. A large
             This utility creates and            functional overlap exists
             deletes queues and queue            between the services each
             sets, modifies queue and            monitor provides. Where


                         Digital Technical Journal Vol. 3 No. 1 Winter 1991  23

 


           Digital's Transaction Processing Monitors



             the functions provided by           on sharing the underlying
             each monitor are identical          code that supports the
             or similar (e.g., client            common features of each
             /server database access and         monitor. As more common
             support for DECforms), the          features are introduced
             factors that distinguish            and enhanced in the DECtp
             one from the other are              system, the investment
             primarily a result of               in applications built
             the use of 4GL and 3GL              on either monitor can
             application programming             be protected and the
             styles and interfaces.              distinctive programming
             Where notable functional            styles of both can be
             differences remain (as in           preserved.
             each product's respective
             queuing or security
             systems), the differences
             are primarily ones of            Reference
             emphasis rather than
             functional incompatibility.         1. Philip A. Bernstein,
             The set of common features             William T. Emberton, and
             shared by both monitors                Vijay Trehan, "DECdta-
             has been growing with the              Digital's Distributed
             latest releases of the ACMS            Transaction Processing
             and DECintact monitors.                Architecture," Digital
             This external convergence              Technical Journal, vol.
             has been fostered and made             3, no. 1 (Winter 1991,
             possible by an internal                this issue): 10-17.
             convergence, which is based



























          24  Digital Technical Journal Vol. 3 No. 1 Winter 1991
=============================================================================
Copyright 1991 Digital Equipment Corporation.  Forwarding and copying of this 
article is permitted for personal and educational purposes without fee 
provided that Digital Equipment Corporation's copyright is retained with the 
article and that the content is not modified. This article is not to be 
distributed for commercial advantage. Abstracting with credit of Digital 
Equipment Corporation's authorship is permitted.  All rights reserved.
=============================================================================
