N1672   . Test Methods for Measuring Conformance to Posix.
                       (IEEE Std 1003.3-1990: "IEEE Standard for information
                        technology - test methods for measuring conformance
                        to Posix", 17-Apr-1991)

                (BSI's IST/5/-/15  has had  an active member on the WG15
                 Rapporteur  Group  on  Conformance  Testing  since  its
                 inception.  Test assertions for the individual parts of
                 IS 9945:1990  developed  using the principles contained
                 in 1003.3,  will be and are being used as the basis for
                 Posix Test Suites).


        Recommended vote:       YES
                                with comments...

              . It is  important  that  IEEE 1003.3 be developed into an
                ISO standard as soon as possible, however IEEE 1003.3 is
                not in itself  sufficient to define  Conformance Testing
                for Posix because:

                a)      It contains no formal testing model.  This leads
                        to confusion.

                b)      There   is   no   provision   for   standardised
                        documentation.  This will also lead to confusion
                        and   undesirable  differences  between  testing
                        laboratory practice.

                c)      IEEE  1003.3  contains  no  procedures  for  the
                        validation  of test  tools or for the testing of
                        OSE profiles derived from more than one standard.

              . IEEE 1003.3  concentrates on providing guidelines on the
                derivation  of test assertions  from base  standards and
                how test suites can be conformant.  It is thus primarily
                aimed at test suite  developers and users of test suites
                (suppliers of implementations).   It doesn't  adequately
                address  the  issues  which affect mutual recognition of
                test  results and  test reports.   These  are the issues
                which  are  of  importance   to  test  laboratories  and
                procurement agencies.  The need for  standardisation has
                become  more  pressing because of the potentially  large
                number of  test  laboratories that will  become involved
                in this  area.  Additionally  there may be more than one
                test suite per base standard/profile.

              . IEEE  1003.3-1991  is a  necessary  but  not  sufficient
                source document to form an ISO standard: other documents
                such as  ISO 9646  Parts 1 (general terminology) through
                5 (testing model) to 6, and EN 45001 to EN 45014  should
                be considered as additional source documents.