External Device Test Cases

KB Home   |   External Device Test Cases

Main.ExternalDeviceTestCases History

Hide minor edits - Show changes to output

March 18, 2019, at 07:22 AM by timg - Added category: testing
Changed line 474 from:
''Categories:'' [[Category.API|+]]
to:
''Categories:'' [[Category.API|+]], [[Category.Testing|+]]
July 16, 2018, at 05:45 AM by 139.130.165.134 -
Changed line 161 from:
An organization uses secure print release to hold jobs in the print queue until the user releases the jobs at the device.  Note: This feature also applies to find-me printing (a.k.a. Follow-Me printing).
to:
An organization uses secure print release to hold jobs in the print queue until the user releases the jobs at the device.  Note: This feature also applies to find-me printing (a.k.a. Pull printing).
May 22, 2018, at 06:39 AM by Alec - Fix formatting
Changed line 309 from:
 Verify that scan tracking works for all possible storage cases:
to:
Verify that scan tracking works for all possible storage cases:
May 22, 2018, at 06:38 AM by Alec - Fix formatting
Changed lines 309-313 from:
* Verify that scan tracking works for all possible storage cases:
** Scan to email
** Scan to network file store
** Scan to device document store
** Scan to locally connected USB media
to:
 Verify that scan tracking works for all possible storage cases:
* Scan to email
* Scan to network file store
* Scan to device document store
* Scan to locally connected USB media
May 22, 2018, at 06:35 AM by Alec - Move general scan testing into test 15 where it belongs
Added lines 309-314:
* Verify that scan tracking works for all possible storage cases:
** Scan to email
** Scan to network file store
** Scan to device document store
** Scan to locally connected USB media

Changed lines 420-424 from:
* Verify that scan tracking works for all possible storage cases:
** Scan to email
** Scan to network file store
** Scan to device document store
** Scan to locally connected USB media
to:
May 14, 2018, at 05:17 AM by Alec - Add note about "Mask identity number" setting
Added line 228:
* When entering an ID the "Mask identity number" (configured on the server) setting must be honoured.
February 08, 2017, at 08:14 PM by Alec - Card self assoc -- check DB is updated with card number
Added line 152:
* Review the contents of the [@Card/Identity Numbers@] field in the PaperCut admin console and check that the card number has been added.
September 10, 2015, at 02:14 AM by Alec - Add overnight test for memory leaks
Changed lines 408-409 from:
* In the morning, test log in (including the card reader) and ensure everything works as expected.
to:
* In the morning, test log in (including the card reader) and ensure everything works as expected.
* Review memory consumption on the PaperCut server, and the device, between the start and end of the test to identify possible memory leaks.
June 30, 2015, at 04:25 AM by Alec - Added note about supporting the correct regions when testing locales
Added line 439:
* Do these supported locals support all the regions in which the solution will be marketed (refer to Go To Market plan)?
June 30, 2015, at 04:22 AM by Alec - Added new test for locale
Added lines 436-441:

!!! Support for multiple currencies and multiple languages (if available)
* Does the device allow the locale to be set in the PaperCut administration interface (Options -> Display Options) or can the locale be set via the solution interface?
* Does the solution display the correct currency symbol when the locale is changed? (e.g. "€")
* Do the messages displayed to the user change to the appropriate language when the solution locale is changed
* Does the supplied documentation explain how to set the locale correctly
Changed lines 439-440 from:
All certified solutions that are intended to be deployed in an education (or other) environment must be audited by PaperCut.  The following list provides details on the most common functions and areas of analysis that mat cause negative feedback:
to:
All certified solutions that are intended to be deployed in an education (or other) environment must be audited by PaperCut.  The following list provides details on the most common functions and areas of analysis that may cause negative feedback:
May 11, 2015, at 12:18 AM by Alec - Added section on security
Changed lines 437-439 from:
!!! Arrange independent security review
* All certified solutions that are intended to be deployed in an education
environment must be independently audited.  Please contact PaperCut support to arrange.
to:
!!!  Security Review

All certified solutions that are intended to be deployed in an education (or other)
environment must be audited by PaperCut.  The following list provides details on the most common functions and areas of analysis that mat cause negative feedback:

* No Zero Stop: Inability to stop a copy or scan job while in progress (say due to an account running out of quota/credit)

* Information-loss due to power cycle or network disruption: The solution should have the ability to persist and remember job details and progress between restarts, power-cycles and network interruptions
.  No job information should be lost as a result of a power-cut or network loss (either inadvertent or malicious) at any stage in any job operation.

* Limited Feature Control: Devices should offer the ability to limit user access/options by:
** Functionality (e.g. scan - no copy)
** Color vs. Grayscale (e.g. grayscale only - no color)

* Limited Secure Protocol Support:  Devices should support modern secure communication protocols (e.g. HTTPS/TLS) for all user-authentication related communication between the device and the server.

* Known Device Security Issue: PaperCut’s in-house development team will check devices for known security issues. Issues found in the past include:
** options to reset hardware back to factory default without requesting admin passwords
** insecure system boot allowing application reset/bypass

All issues discovered will be reported privately to the vendor and PaperCut will work with the vendor to action as appropriate.

* Limited Production Maturity:  Any new solution with no known issues at the time of release will reviewed again after a 12 month security-issue free period. 

April 14, 2015, at 11:02 AM by Alec - Added note about testing install process and docs
Added lines 422-425:
!!! Verify Installation Process
* Install the solution from scratch using the supplied documentation
* Note any issues or problems

March 16, 2015, at 11:06 PM by 203.222.91.204 -
Changed lines 163-168 from:
* In PaperCut, enable the "Hold/Release Queue" on a test print queue.
* For the device, enable the "Print Release" option
* Select the print queue configured above under the "Displays jobs for release from the selected queues" option.
* Ensure the "Automatically release user's jobs upon login" option is disabled.
* Print some test jobs to the queue and confirm
the jobs are listed in "Printers -> Jobs Pending Release".  If the jobs are listed here they will be ready to release on the device. Ensure there are print jobs for two different users.
to:
* In PaperCut, select a printer and enable “Enable hold/release queue”.
* Select the device and enable “Enable print release”.
* Under “Displays jobs for release from the selected queues”, select the print queue configured above, and ensure “Automatically release user’s jobs upon login” is disabled.
* Print about 12 test jobs (to fill at least two screens of
the held jobs list on the device) and confirm the jobs are listed in “Printers → Jobs Pending Release”. All jobs listed here will be ready for release on the device. Also print a few jobs as another user.
Changed lines 169-174 from:
* Log in to the device as one of the users that printed the jobs waiting for release.
* The user should be prompted to select to use the copier or release print jobs.
* When
user selects to release print jobs they should be displayed a list of jobs to release. This should contain only their jobs. Not the jobs of the other user.
* As jobs are released they should be printed and logged in PaperCut
* If jobs are cancelled, the job should not print
.
to:
* Log in to the device as the first user (i.e., user that printed the larger number of jobs).
* Select Release Print Jobs. A list of held jobs is displayed. This should contain only the first user's jobs, not the jobs of the other user.
* Scroll/page through the list and check that no jobs are missing
.
* Release some jobs and cancel others. Released jobs should be printed and logged in PaperCut. Cancelled jobs should be logged in PaperCut and not printed.
Changed lines 88-91 from:
* Repeat the proceeding two steps for account 2222.
* Repeat for account 3333 (invalid account).  Confirm that a suitable error message displays.
* Repeat for account 4444. The user should have access to Physics even without security access granted when using the PIN.
to:
* Repeat the preceeding two steps for account 2222.
* Repeat for account 3333 (invalid account).  Confirm that a suitable error message is displayed.
* Repeat for account 4444. The user should have access to Physics when using the PIN, even without security access being granted.
Changed lines 81-82 from:
to:
** Physics : set code to 4444 (do not explicitly grant the user access to this account)
Changed lines 90-91 from:
to:
* Repeat for account 4444. The user should have access to Physics even without security access granted when using the PIN.
Changed lines 135-136 from:

to:
* Searching for "ccoun" should also return all 5000 accounts.

Changed lines 167-168 from:
* Print some test jobs to the queue and confirm the jobs are listed in "Printers -> Jobs Pending Release".  If the jobs are listed here they will be ready to release on the device.
to:
* Print some test jobs to the queue and confirm the jobs are listed in "Printers -> Jobs Pending Release".  If the jobs are listed here they will be ready to release on the device. Ensure there are print jobs for two different users.
Changed line 170 from:
* Log in to the device as the user that printed the jobs waiting for release.
to:
* Log in to the device as one of the users that printed the jobs waiting for release.
Changed line 172 from:
* When user selects to release print jobs they should be displayed a list of jobs to release.
to:
* When user selects to release print jobs they should be displayed a list of jobs to release. This should contain only their jobs. Not the jobs of the other user.
Changed lines 184-187 from:

!! Test Case 8: Secure Print Release (auto release enabled)
An organization uses secure print release to hold jobs
in the print queue.  When the user logs into the device they want all jobs to be released automatically upon successful login.
to:
!! Test Case 8 : Print Release (permissions to release any print jobs)
Devices have an option that allow the logged
in user to release any print jobs, regardless of owner.
Changed lines 188-190 from:
* Setup PaperCut as per Test Case 7: Secure Print Release.
* In
the device configuration enable the option "Automatically release user's jobs upon login".  This can be found under the device's print release settings.
to:
* Prepare Test Case 7, with the additional Setup step of using the 'Users have permission to:' drop down box to select 'release any print jobs (charged to their account)'.
Added lines 191-200:
* Repeat the Tests from Test Case 7 this time ensuring you see all print jobs for all users.

!! Test Case 9: Secure Print Release (auto release enabled)
An organization uses secure print release to hold jobs in the print queue.  When the user logs into the device they want all jobs to be released automatically upon successful login.

!!! Setup
* Setup PaperCut as per Test Case 7: Secure Print Release.
* In the device configuration enable the option "Automatically release user's jobs upon login".  This can be found under the device's print release settings.

!!! Tests
Changed line 209 from:
!! Test Case 9: Lost card (alternate login methods)
to:
!! Test Case 10: Lost card (alternate login methods)
Changed lines 228-229 from:

!! Test Case 10: Two Factor Authentication
to:
* Password and PIN fields should be masked when entering values.

!! Test Case 11
: Two Factor Authentication
Changed line 259 from:
!! Test Case 11: Account tracking only (auto login)
to:
!! Test Case 12: Account tracking only (auto login)
Changed line 285 from:
!! Test Case 12: General Copy Job Attribute Tests
to:
!! Test Case 13: General Copy Job Attribute Tests
Changed lines 296-306 from:
!! Test Case 13: Fax and Scan Tests
to:
!! Test Case 14: ‘Enable hold/release queue – disabled’
When an embedded application is installed on the MFD and the queue that services the device in PaperCut is not configured as a hold/release queue, prints should emerge from the device without any user intervention at the device itself.
 
!!!Setup
# Successfully complete Test Case 7
# Uncheck the ‘Enable hold/release queue’ option in PaperCut for this print queue

!!!Tests
# Print some test jobs to the queue and confirm their pages print without any additional intervention.

!! Test Case 15
: Fax and Scan Tests
Changed line 309 from:
!! Test Case 14: Exception, Security and General Tests
to:
!! Test Case 16: Exception, Security and General Tests
Added line 17:
* Set the user to "Automatically charge to personal account"
Added line 20:
Changed lines 52-53 from:
to:
* Create a third account "Physics" and ensure the user does not have access to this account.
Added line 66:
** Zero-stop rules should apply to restricted accounts that exhaust their balance.
May 14, 2014, at 12:07 AM by 203.222.113.44 -
Changed lines 358-359 from:
* Test with a different country display setting. Go into Options->Display Options->Location and change the language to one of the supported languages which is not English (and preferably that uses non-English characters - e.g. Chinese, German, etc.). Check on the device that the characters are displayed properly.
to:
* Test with a different country display setting. Go into Options -> Display Options -> Location and change the language to one of the supported languages which is not English (and preferably that uses non-English characters - e.g. Chinese, German, etc.). Check on the device that the characters are displayed properly.
Changed line 371 from:
* If the device runs, or connects to an MFD/MFP ensure that the integration does not stop the MFD from entering any of the manufacture's designed power saving modes.
to:
* If the device runs, or connects to an MFD/MFP ensure that the integration does not stop the MFD from entering any of the manufacturer's designed power saving modes.
May 13, 2014, at 06:54 AM by 203.222.113.44 -
Changed line 67 from:
!! Test Case 3: Teacher user (pin/code account selection)
to:
!! Test Case 3: Teacher user (PIN/code account selection)
Changed line 357 from:
* The devise should handle printer, document, account, user and workstation names with special characters.  Characters to check include: [@ < > & ; @ ' " @] and non-Latin characters as appropriate.  Take time to check each area.
to:
* The device should handle printer, document, account, user and workstation names with special characters.  Characters to check include: [@ < > & ; @ ' " @] and non-Latin characters as appropriate.  Take time to check each area.
May 13, 2014, at 06:29 AM by 203.222.113.44 -
Changed line 208 from:
* The interface should guide the user to the options available.  The interface will depend on the capabilities of the device.  On a limited display device the screen might show "Swipe card or press X to enter username/password".  On a graphic/touch screen the alternate login options may be presented as buttons.
to:
* The interface should guide the user to the options available.  The interface will depend on the capabilities of the device.  On a limited display device the screen might show "Swipe card or press X to enter username/password".  On a graphic/touch screen, the alternate login options may be presented as buttons.
Changed lines 230-231 from:
* The user should be informed that the new PIN is assigned and device's access granted.
to:
* The user should be informed that the new PIN is assigned and device access granted.
Changed lines 251-252 from:
* Ensure copier user has access to at least two Shared Accounts (e.g. Shared Accounts -> Account Details –> Security)
to:
* Ensure copier user has access to at least two Shared Accounts (e.g. Shared Accounts -> Account Details –> Security).
Changed line 270 from:
Conduct some general copy job attribute tests making sure the job is correctly recorded in the device's job log (Device -> [select device] -> Job Log).  At a minimum test the follow job settings (if supported by the device):
to:
Conduct some general copy job attribute tests making sure the job is correctly recorded in the device's job log (Device -> [select device] -> Job Log).  At a minimum test the following job settings (if supported by the device):
Changed lines 284-285 from:
The following tests cover security, exception and general tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.  Please record the result of each section below and allow adequate time to complete all tests.  These tests are some of the most important in the series and are often the ones that demonstrate problems with initial implementations.
to:
The following tests cover security, exception and general tests.  The focus is on tricky corner-cases that may show up bugs or unexpected behavior in real-life environments.  Please record the result of each section below and allow adequate time to complete all tests.  These tests are some of the most important in the series and are often the ones that demonstrate problems with initial implementations.
Changed line 299 from:
* Try logging in, etc. Confirm that it handles the error gracefully (e.g. displays a reasonable error).
to:
* Try logging in, etc. Confirm that it handles the error gracefully, i.e. displays a reasonable message.
Changed lines 307-308 from:
* Try logging in again and confirm that copy tracking works as expected (e.g. perform a test job)
to:
* Try logging in again and confirm that copy tracking works as expected (e.g. perform a test job).
Changed lines 348-349 from:
* Start a 500 page copy job .... cancel it after 10-ish pages copied and confirm it's logged correctly.
to:
* Start a 500 page copy job .... cancel it after about 10 pages have been copied and confirm it's logged correctly.
Changed lines 351-352 from:
* The device must handle long Shared Account names. Add a new account called: "This is a very long account name and should not affect screen layout or usability".  Verify that account can be selected by the user and it does not disrupt any screen layout (truncating names with "..." may be acceptable.)
to:
* The device must handle long Shared Account names. Add a new account called: "This is a very long account name and should not affect screen layout or usability".  Verify that account can be selected by the user and it does not disrupt any screen layout (truncating names with "..." may be acceptable).
Changed lines 354-355 from:
* The device must handle the secure release of jobs with long names. Try printing a document from such as a MS Word document with a long file name, or a web page with a very long URL.  Verify that the print job can be released by a user and the long name not disrupt any screen layout (truncating names with "..." may be acceptable.)
to:
* The device must handle the secure release of jobs with long names. Try printing a document from such as a MS Word document with a long file name, or a web page with a very long URL.  Verify that the print job can be released by a user and the long name not disrupt any screen layout (truncating names with "..." may be acceptable).
Changed lines 378-379 from:
* Make sure the device enters an "Offline" state in the PaperCut Admin Console's device status. (Note: It should not enter an "Error" state).
to:
* Make sure the device enters an "Offline" state in the PaperCut Admin Console's device status. (Note: It should not enter an "Error" state.)
Changed lines 396-397 from:
* Verify that a delayed Fax job eventually logs, e.g. unplug phone cable for 10 minutes, reconnected and ensure the job logs when finally completes.
to:
* Verify that a delayed Fax job eventually logs, e.g. unplug phone cable for 10 minutes, reconnect and ensure the job is logged when it finally completes.
May 13, 2014, at 06:15 AM by 203.222.113.44 -
Changed line 342 from:
* Make a price configuration change on the device in the PaperCut administration console.  Verify that the device auto detects this change within a minimum of 60 seconds.
to:
* Make a price configuration change on the device in the PaperCut administration console.  Verify that the device automatically detects this change within 60 seconds.
Changed lines 344-345 from:
-->[-(Note: It is acceptable for the device to trigger off a "reboot" to refresh it's settings.  This is often the simplest way to implement configuration change detection.)-]
to:
-->[-(Note: It is acceptable for the device to trigger off a "reboot" to refresh its settings.  This is often the simplest way to implement configuration change detection.)-]
Changed lines 361-362 from:
* The device must be able to handle listing of large account lists.  Some PaperCut customers have over 100,000 shared accounts (e.g. client accounts).  Test and make sure the device performs acceptably with 100,000 shared accounts (Tip:  Many accounts can be created quickly using MS Excel and the batch account import process).
to:
* The device must be able to handle listing of large account lists.  Some PaperCut customers have over 100,000 shared accounts (e.g. client accounts).  Test and make sure the device performs acceptably with 100,000 shared accounts. (Tip:  Many accounts can be created quickly using MS Excel and the batch account import process.)
May 13, 2014, at 04:21 AM by 203.222.113.44 -
Changed line 173 from:
* When giving the user the option to select between copying and print release it is recommended to display the number of currently held jobs to the user.  E.g "Print release (3 jobs)"
to:
* When giving the user the option to select between copying and print release it is recommended to display the number of currently held jobs to the user, e.g. "Print release (3 jobs)".
Changed lines 234-237 from:
* The device should prompt for the PIN number.
* Enter a correct PIN number and ensure device use is granted.
* Enter an invalid PIN number and ensure devices access is denied.
to:
* The device should prompt for the PIN.
* Enter a correct PIN and ensure device use is granted.
* Enter an invalid PIN and ensure device access is denied.
Changed lines 240-241 from:
* Message should appear on the screen helping the user understand why they have been requested for a PIN.  Suggested text:  "Please enter a new PIN number to associate with your card."
* If using "ID" authentication the user interface should only request a PIN number if one is required.  On GUI interface this might mean there is no PIN field if a PIN is not required.
to:
* Message should appear on the screen helping the user understand why they have been requested for a PIN.  Suggested text:  "Please enter a new PIN to associate with your card."
* If using "ID" authentication the user interface should only request a PIN if one is required.  In the GUI, this might mean there is no PIN field if a PIN is not required.
Changed lines 358-359 from:
* Test with a different country display setting. Go into Options->Display Options->Location and change the language to one of the supported languages which is not English (and preferably that uses non-english characters - e.g. Chinese, German, etc. Check on the device that the characters are displayed properly.
to:
* Test with a different country display setting. Go into Options->Display Options->Location and change the language to one of the supported languages which is not English (and preferably that uses non-English characters - e.g. Chinese, German, etc.). Check on the device that the characters are displayed properly.
Changed lines 378-379 from:
* Make sure the device enters an "Offline" state in the PaperCut Admin Console's device status. (Note: It should not enter an "Error" state)
to:
* Make sure the device enters an "Offline" state in the PaperCut Admin Console's device status. (Note: It should not enter an "Error" state).
May 13, 2014, at 04:16 AM by 203.222.113.44 -
Changed line 73 from:
* Change their account selection settings to "Show the Standard Account Selection Popup".  Disable the  "shared account with list" and "personal account" options.  Enable the "shared account with code" option.
to:
* Change their account selection settings to "Show the Standard Account Selection Popup".  Disable the "shared account with list" and "personal account" options.  Enable the "shared account with code" option.
Changed line 90 from:
* Setup a  corporate user in PaperCut (e.g. corporateuser)
to:
* Set up a corporate user in PaperCut (e.g. corporateuser)
Changed line 95 from:
* Log in to the device as the corporate user
to:
* Log in to the device as the corporate user.
Changed lines 109-110 from:
* Setup the professional user's "Account Selection" settings to be "Show the Advanced Account Selection popup" and disable the "Allow to charge to their personal account" option.
to:
* Set up the professional user's "Account Selection" settings to be "Show the Advanced Account Selection popup" and disable the "Allow to charge to their personal account" option.
Changed lines 114-116 from:
**  the option to select account by pin/code 
** the option to select accounts from a list.
** And
importantly, the option to search for the account by name
to:
** the option to select account by PIN/code;
** the option to select accounts from a list; and importantly
** the option to search for the account by name.
Changed line 121 from:
* Select an account and perform copying
to:
* Select an account and perform copying.
Changed line 125 from:
* When a user has access to many accounts it is of little use to display a very long list.  The user should first be presented with the option to choose how to search for an account (e.g. by pin/code by name, etc)
to:
* When a user has access to many accounts it is of little use to display a very long list.  The user should first be presented with the option to choose how to search for an account (e.g. by PIN/code by name, etc.).
Changed lines 128-130 from:
* When a "default shared account" is set for the user, the user interface should change to make this account easy to select with minimal steps/presses. i.e. it may appear as an option in the same screen as where the account search is provided.

to:
* When a "default shared account" is set for the user, the user interface should change to make this account easy to select with minimal steps/presses, i.e. it may appear as an option in the same screen as where the account search is provided.

Changed lines 175-177 from:
* There is a lot of information about the jobs being held (e.g. doc name, user, client machine, time, pages, cost, etc).  Ideally all these attributes would be visible to the user, but on constrained devices this may not be possible.  The most important attribute to display for print release is the document name. 

to:
* There is a lot of information about the jobs being held (e.g. doc name, user, client machine, time, pages, cost, etc.).  Ideally all these attributes would be visible to the user, but on constrained devices this may not be possible.  The most important attribute to display for print release is the document name. 

Changed lines 248-249 from:
* In PaperCut under the device's authentication option, enable the "Automatically login as user"  option.
* Enter the name "copieruser".  All jobs will be tracked against this user. 
to:
* In PaperCut under the device's authentication option, enable the "Anonymous (No login required)" option.
* Enter the name "copieruser".  All jobs will be tracked against this user.
Changed line 262 from:
* Change the "copieruser's" account selection option to "Automatically charge to personal account"
to:
* Change the account selection option for "copieruser" to "Automatically charge to personal account"
Changed line 276 from:
* Dupex
to:
* Duplex
May 12, 2014, at 06:57 AM by 203.222.113.44 -
Changed lines 49-50 from:
* Create two accounts "Science" and "Maths" and grant this user access to these accounts (through Account->Security).
to:
* Create two accounts "Science" and "Maths" and grant this user access to these accounts (through Account -> Security).
Changed lines 153-154 from:
An organization uses secure print release to hold jobs in the print queue until the user releases the jobs at the device.  Note: This feature also applies to find-me printing (aka Follow-Me printing).
to:
An organization uses secure print release to hold jobs in the print queue until the user releases the jobs at the device.  Note: This feature also applies to find-me printing (a.k.a. Follow-Me printing).
Changed lines 160-161 from:
* Print some test jobs to the queue and confirm the jobs are listed in "Printers->Jobs Pending Release".  If the jobs are listed here they will be ready to release on the device.
to:
* Print some test jobs to the queue and confirm the jobs are listed in "Printers -> Jobs Pending Release".  If the jobs are listed here they will be ready to release on the device.
Changed lines 251-252 from:
* Ensure copier user has access to at least two Shared Accounts (e.g. Shared Accounts -> Account  Details –> Security)
to:
* Ensure copier user has access to at least two Shared Accounts (e.g. Shared Accounts -> Account Details –> Security)
Changed lines 267-268 from:
* If there is no account selection (e.g. automatically charge to personal account) the device may display an initial prompt for the user to enable the copier.  E.g. "Press to begin".
to:
* If there is no account selection (e.g. automatically charge to personal account) the device may display an initial prompt for the user to enable the copier, e.g. "Press to begin".
Changed line 270 from:
Conduct some general copy job attribute tests making sure the job is correctly recorded in the device's job log (Device -> [select device -> Job Log).  At a minimum test the follow job settings (if supported by the device):
to:
Conduct some general copy job attribute tests making sure the job is correctly recorded in the device's job log (Device -> [select device] -> Job Log).  At a minimum test the follow job settings (if supported by the device):
Changed line 333 from:
* After about 10 pages , hard power off the device (e.g. power off at the power point).
to:
* After about 10 pages, hard power off the device (e.g. power off at the power point).
Changed lines 396-397 from:
* Verify that a delayed Fax job eventually logs.  E.g. Unplug phone cable for 10 minutes, reconnected and ensure the job logs when finally completes.
to:
* Verify that a delayed Fax job eventually logs, e.g. unplug phone cable for 10 minutes, reconnected and ensure the job logs when finally completes.
May 12, 2014, at 06:53 AM by 203.222.113.44 -
Changed lines 339-340 from:
* When the device is configured to point to a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.
to:
* When the device is configured to point to a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call).
May 12, 2014, at 06:51 AM by 203.222.113.44 -
Changed line 79 from:
* Login to the device as the teacher user.
to:
* Log in to the device as the teacher user.
Changed line 90 from:
* Setup a  corporate user in PaperCut (e.g. coperateuser)
to:
* Setup a  corporate user in PaperCut (e.g. corporateuser)
Changed lines 95-96 from:
* Login to the device as the corporate user
* After login the copier should be enabled for use.
to:
* Log in to the device as the corporate user
* After login, the copier should be enabled for use.
Changed line 112 from:
* Login to the device as the professional user
to:
* Log in to the device as the professional user
Changed line 142 from:
* Attempt to login by swiping the card
to:
* Attempt to log in by swiping the card
Changed line 163 from:
* Login to the device as the user that printed the jobs waiting for release.
to:
* Log in to the device as the user that printed the jobs waiting for release.
Changed line 186 from:
* Login to the device as the user that printed the jobs waiting for release.
to:
* Log in to the device as the user that printed the jobs waiting for release.
Changed lines 195-196 from:
User in this scenario normally authenticate with cards, however users should also be able to login with alternate login methods.  This is useful when user has misplaced their card (e.g. left their card at home).  An alternate login method, all be it less convenient, will ensure the user still has copying and secure print release access.
to:
User in this scenario normally authenticate with cards, however users should also be able to log in with alternate login methods.  This is useful when user has misplaced their card (e.g. left their card at home).  An alternate login method, although less convenient, will ensure the user still has copying and secure print release access.
Changed lines 202-205 from:
* When the user approaches the device they should be able to login with either card or username/password.
* Test that the user can successfully login with a card.
* Test that the user can successfully login with a username and password.
to:
* When the user approaches the device they should be able to log in with either card or username/password.
* Test that the user can successfully log in with a card.
* Test that the user can successfully log in with a username and password.
Changed lines 244-245 from:
A company wants to charge printing to accounts, but is not interested in tracking copying at the individual user level.  It is more important for them to speed up access to the copier by not requiring that users login.
to:
A company wants to charge printing to accounts, but is not interested in tracking copying at the individual user level.  It is more important for them to speed up access to the copier by not requiring that users log in.
Changed lines 295-296 from:
* Confirm you can login after the restart is completed
to:
* Confirm you can log in after the restart is completed.
Changed line 305 from:
* Leave device idle for 10 minutes (do not login).
to:
* Leave device idle for 10 minutes (do not log in).
Changed lines 322-323 from:
* Confirm the device connects and you can login.
to:
* Confirm the device connects and you can log in.
Changed lines 361-362 from:
* The device must be able to handel listing of large account lists.  Some PaperCut customers have over 100,000 shared accounts (e.g. client accounts).  Test and make sure the device performs acceptably with 100,000 shared accounts (Tip:  Many accounts can be created quickly using MS Excel and the batch account import process).
to:
* The device must be able to handle listing of large account lists.  Some PaperCut customers have over 100,000 shared accounts (e.g. client accounts).  Test and make sure the device performs acceptably with 100,000 shared accounts (Tip:  Many accounts can be created quickly using MS Excel and the batch account import process).
Changed line 364 from:
* Plug in card-reader and confirm it's working (e.g. login).
to:
* Plug in card-reader and confirm it's working (e.g. log in).
Changed line 382 from:
* Plug in card-reader and confirm it's working (e.g. login).
to:
* Plug in card-reader and confirm it's working (e.g. log in).
Changed lines 384-385 from:
* In the morning test login (including the card reader) and ensure everything works as expected.
to:
* In the morning, test log in (including the card reader) and ensure everything works as expected.
Changed lines 392-393 from:
* Load the document feeder with a large document and start scanning.  Cancel scanning via cancel button and logout.  Ensure job tracks/records as expected.
to:
* Load the document feeder with a large document and start scanning.  Cancel scanning via cancel button and log out.  Ensure job tracks/records as expected.
Changed lines 404-406 from:
* Conduct a card swipe login
* Verify that the card number was not passed in clear text (e.g. search packet content using Wireshark search)
* Conduct a username and password login
to:
* Conduct a card swipe login.
* Verify that the card number was not passed in clear text (e.g. search packet content using Wireshark search).
* Conduct a username and password login.
Changed lines 412-413 from:
[-keywords: certification, test plan, test cases, usecases, hardware terminal testing, copier controller testing -]
to:
[-keywords: certification, test plan, test cases, use cases, hardware terminal testing, copier controller testing -]
May 12, 2014, at 06:25 AM by 203.12.22.94 -
Changed lines 15-18 from:
* Setup a student test user in PaperCut
* Set the user to be "restricted"
* Set the device copy cost (e.g. $0.10 per page)
to:
* Set up a student test user in PaperCut.
* Set the user to be "restricted".
* Set the device copy cost, e.g. $0.10 per page.
Changed lines 21-23 from:
* Allocate the user a small balance. E.g. $2.00
* Login as the student user.
* Perform some copying (or scanning/faxing if supported)
to:
* Allocate the user a small balance, e.g. $2.00.
* Log in as the student user.
* Perform some copying (or scanning/faxing if supported).
Changed line 28 from:
* Try logging in as the student
to:
* Try logging in as the student.
Changed lines 32-34 from:
* Set the user's balance to a small value.  E.g. $0.50
* Login
as the user
* Perform a copy that will cost more than their balance
to:
* Set the user's balance to a small value, e.g. $0.50.
* Log in as the user.
* Perform a copy that will cost more than the user's balance.
Changed lines 38-40 from:
* For "restricted" users, their account available balance should be displayed to them after successful login or throughout copier usage.

to:
* For "restricted" users, the user's account available balance should be displayed after successful login or throughout copier usage.

Changed line 46 from:
* Setup a teacher test user in PaperCut
to:
* Set up a teacher test user in PaperCut
Changed lines 52-54 from:
* Login to the device as the teacher user.
* The user should be prompted for the account to charge their copying.  They should be able to select the accounts from a list.  The list be:
** Personal Account
to:
* Log in to the device as the teacher user.
* The user should be prompted for the account to charge their copying.  They should be able to select the accounts from a list.  The list should be:
Changed line 56 from:
* Once the account is selected perform some copies.
to:
* Once the account is selected, perform some copies.
Changed lines 58-59 from:
* Repeat this test selecting each account option in turn.  Confirm jobs are logged correctly.
to:
* Repeat this test, selecting each account option in turn.  Confirm jobs are logged correctly.
Changed lines 61-66 from:
* When users select "unrestricted" accounts the account balance is not relevant and should not be presented to the user.  If something is to be displayed it should be "unrestricted".
* When users select "restricted" accounts the account balance should be displayed to the user.
* When users have a small number of accounts then it's preferable to minimize the number of steps.  It is not appropriate to provide an "Account search" option when the list is so short.  When there is a small number of accounts it is recommend to simply display them in a selectable list format.
* When a "default shared account" is set for the user, the user interface should change to make this account easy to select with minimal steps/presses. i.e. it might appear at the top of the account list so it can be selected with one click.

to:
* When users select "unrestricted" accounts, the account balance is not relevant and should not be presented to the user.  If something is to be displayed it should be "unrestricted".
* When users select "restricted" accounts, the account balance should be displayed to the user.
* When users have a small number of accounts, it's preferable to minimize the number of steps.  It is not appropriate to provide an "Account search" option when the list is so short.  When there is a small number of accounts, it is recommended to simply display them in a selectable list format.
* When a "default shared account" is set for the user, the user interface should change to make this account easy to select with minimal steps/presses, i.e. it might appear at the top of the account list so it can be selected with one click.

April 29, 2014, at 10:50 PM by 203.12.22.94 -
Changed lines 308-309 from:
to:
* Try logging in again and confirm that copy tracking works as expected (e.g. perform a test job)
Changed line 48 from:
* Change their account selection settings to "Show the Standard Account Selection Popop" and enable "select shared account with list" only.  Disable the "personal" and "shared account with code" options.
to:
* Change their account selection settings to "Show the Standard Account Selection Popup" and enable "select shared account with list" only.  Disable the "personal" and "shared account with code" options.
Changed line 74 from:
* Change their account selection settings to "Show the Standard Account Selection Popop".  Disable the  "shared account with list" and "personal account" options.  Enable the "shared account with code" option.
to:
* Change their account selection settings to "Show the Standard Account Selection Popup".  Disable the  "shared account with list" and "personal account" options.  Enable the "shared account with code" option.
Changed lines 358-359 from:
* Test with a different country display setting. Go into Options->Display Options->Location and change the language to one of the supported languages which is not English. Check on the device that the characters are displayed properly.
to:
* Test with a different country display setting. Go into Options->Display Options->Location and change the language to one of the supported languages which is not English (and preferably that uses non-english characters - e.g. Chinese, German, etc. Check on the device that the characters are displayed properly.
January 24, 2013, at 03:07 AM by tim - add test about different language display options
Changed lines 358-359 from:
to:
* Test with a different country display setting. Go into Options->Display Options->Location and change the language to one of the supported languages which is not English. Check on the device that the characters are displayed properly.
Changed lines 147-148 from:
* Repeat these test and ensure an invalid username/password does not allow association and feedback is appropriate.
to:
* Repeat these tests and ensure an invalid username/password does not allow association and feedback is appropriate.
Changed lines 377-378 from:
* Make sure the device enters an "Offline" state in the PaperCut Admin Console's device status.
to:
* Make sure the device enters an "Offline" state in the PaperCut Admin Console's device status. (Note: It should not enter an "Error" state)
Added lines 369-378:
!!! Power saving mode test
* If the device runs, or connects to an MFD/MFP ensure that the integration does not stop the MFD from entering any of the manufacture's designed power saving modes.
* Make sure when the device enters a power saving mode, it still appears as connected/idle in PaperCut's device status.
* Ensure functionality returns after the MFD is woken from power saving mode(s).

!!! Power-off idle test
* Turn the MFD/Device off (full power off at the power point).
* Wait 10 minutes.
* Make sure the device enters an "Offline" state in the PaperCut Admin Console's device status.

July 30, 2012, at 02:20 AM by 203.222.91.204 -
Deleted lines 286-297:
!!! Long Shared Account name
* The device must handle long Shared Account names. Add a new account called: "This is a very long account name and should not affect screen layout or usability".  Verify that account can be selected by the user and it does not disrupt any screen layout (truncating names with "..." may be acceptable.)

!!! Long Print Job names
* The device must handle the secure release of jobs with long names. Try printing a document from such as a MS Word document with a long file name, or a web page with a very long URL.  Verify that the print job can be released by a user and the long name not disrupt any screen layout (truncating names with "..." may be acceptable.)

!!! Names with special characters
* The devise should handle printer, document, account, user and workstation names with special characters.  Characters to check include: [@ < > & ; @ ' " @] and non-Latin characters as appropriate.  Take time to check each area.

!!! Large Share Account Lists
* The device must be able to handel listing of large account lists.  Some PaperCut customers have over 100,000 shared accounts (e.g. client accounts).  Test and make sure the device performs acceptably with 100,000 shared accounts (Tip:  Many accounts can be created quickly using MS Excel and the batch account import process).

Changed lines 293-318 from:
!!! Invalid license
* When the device is configured to point to a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.

!!! Device automatic reconfiguration
* Make a price configuration change on the device in the PaperCut administration console.  Verify that the device auto detects this change within a minimum of 60 seconds.
* Change other configuration options that are statefully stored on the device (e.g. price line settings) and verify they are detected within 60 seconds.
-->[-(Note: It is acceptable for the device to trigger off a "reboot" to refresh it's settings.  This is often the simplest way to implement configuration change detection.)-]

!!! Large copy job
* Perform a 100 page copy job ... allow it to complete and confirm it's logged correctly.
* Start a 500 page copy job .... cancel it after 10-ish pages copied and confirm it's logged correctly.

!!! Stop PaperCut Application Server during copying
* Start a large copy job (suggested 100 pages).
* While in progress stop the PaperCut application server (e.g. Services -> PaperCut Application Server -> Stop).
* Wait for job to complete, etc.
* Restart the Application Server a few minutes later, and confirm that the job is logged correctly.

!!! Hard power-off during copy
('''NOTE:''' don't do this too often may be not good for device)
* Start a large copy job.
* After about 10 pages , hard power off the device (e.g. power off at the power point).
* Note the number of pages actually produced.
* Restart the device.
* Confirm that the pages are counted correctly (within reason as some may still be half stuck in the device).

to:
Added lines 324-361:
!!! Stop PaperCut Application Server during copying
* Start a large copy job (suggested 100 pages).
* While in progress stop the PaperCut application server (e.g. Services -> PaperCut Application Server -> Stop).
* Wait for job to complete, etc.
* Restart the Application Server a few minutes later, and confirm that the job is logged correctly.

!!! Hard power-off during copy
('''NOTE:''' don't do this too often may be not good for device)
* Start a large copy job.
* After about 10 pages , hard power off the device (e.g. power off at the power point).
* Note the number of pages actually produced.
* Restart the device.
* Confirm that the pages are counted correctly (within reason as some may still be half stuck in the device).

!!! Invalid license
* When the device is configured to point to a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.

!!! Device automatic reconfiguration
* Make a price configuration change on the device in the PaperCut administration console.  Verify that the device auto detects this change within a minimum of 60 seconds.
* Change other configuration options that are statefully stored on the device (e.g. price line settings) and verify they are detected within 60 seconds.
-->[-(Note: It is acceptable for the device to trigger off a "reboot" to refresh it's settings.  This is often the simplest way to implement configuration change detection.)-]

!!! Large copy job
* Perform a 100 page copy job ... allow it to complete and confirm it's logged correctly.
* Start a 500 page copy job .... cancel it after 10-ish pages copied and confirm it's logged correctly.

!!! Long Shared Account name
* The device must handle long Shared Account names. Add a new account called: "This is a very long account name and should not affect screen layout or usability".  Verify that account can be selected by the user and it does not disrupt any screen layout (truncating names with "..." may be acceptable.)

!!! Long Print Job names
* The device must handle the secure release of jobs with long names. Try printing a document from such as a MS Word document with a long file name, or a web page with a very long URL.  Verify that the print job can be released by a user and the long name not disrupt any screen layout (truncating names with "..." may be acceptable.)

!!! Names with special characters
* The devise should handle printer, document, account, user and workstation names with special characters.  Characters to check include: [@ < > & ; @ ' " @] and non-Latin characters as appropriate.  Take time to check each area.

!!! Large Shared Account Lists
* The device must be able to handel listing of large account lists.  Some PaperCut customers have over 100,000 shared accounts (e.g. client accounts).  Test and make sure the device performs acceptably with 100,000 shared accounts (Tip:  Many accounts can be created quickly using MS Excel and the batch account import process).

Changed lines 270-281 from:
!! Test Case 12: Fax and Scan Tests
to:
!! Test Case 12: General Copy Job Attribute Tests
Conduct some general copy job attribute tests making sure the job is correctly recorded in the device's job log (Device -> [select device -> Job Log).  At a minimum test the follow job settings (if supported by the device):
* Letter
* A4
* Legal
* 11x17
* A3
* Dupex
* Black & White/Grayscale vs. Color
* Copy zooming (making sure the size recorded is the output size rather than the scan size)

!! Test Case 13
: Fax and Scan Tests
Changed line 284 from:
!! Test Case 13: Exception, Security and General Tests
to:
!! Test Case 14: Exception, Security and General Tests
Added lines 285-287:
!!! Large Share Account Lists
* The device must be able to handel listing of large account lists.  Some PaperCut customers have over 100,000 shared accounts (e.g. client accounts).  Test and make sure the device performs acceptably with 100,000 shared accounts (Tip:  Many accounts can be created quickly using MS Excel and the batch account import process).

Changed lines 282-284 from:
!!! Print and Job names with special characters
* The devise should handle printer
, document and workstation names with special characters.  Characters to check include: [@ < > & ; @ ' " @] and non-Latin characters as appropriate.
to:
!!! Names with special characters
* The devise should handle printer, document, account
, user and workstation names with special characters.  Characters to check include: [@ < > & ; @ ' " @] and non-Latin characters as appropriate.  Take time to check each area.
Added lines 282-284:
!!! Print and Job names with special characters
* The devise should handle printer, document and workstation names with special characters.  Characters to check include: [@ < > & ; @ ' " @] and non-Latin characters as appropriate.

Changed lines 276-281 from:
to:
!!! Long Shared Account name
* The device must handle long Shared Account names. Add a new account called: "This is a very long account name and should not affect screen layout or usability".  Verify that account can be selected by the user and it does not disrupt any screen layout (truncating names with "..." may be acceptable.)

!!! Long Print Job names
* The device must handle the secure release of jobs with long names. Try printing a document from such as a MS Word document with a long file name, or a web page with a very long URL.  Verify that the print job can be released by a user and the long name not disrupt any screen layout (truncating names with "..." may be acceptable.)

Changed lines 192-193 from:
* The message displayed on login if jobs are released should ideally indicate the number of jobs released.
to:
* The message displayed on login if jobs are released should ideally indicate the number of jobs released. 
* If multiple jobs are held for a user but not enough to release all the jobs, user should be given an option to select the job(s) they want to release.

Changed line 74 from:
* Change their account selection settings to "Show the Standard Account Selection Popop" and enable "personal account" and "shared account with pin".  Disable the  "shared account with list" and "personal account" options.  Disable the "shared account with code" option.
to:
* Change their account selection settings to "Show the Standard Account Selection Popop".  Disable the  "shared account with list" and "personal account" options.  Enable the "shared account with code" option.
Changed line 20 from:
User has credit balance:
to:
a) User has credit balance:
Changed line 26 from:
User has no balance:
to:
b) User has no balance:
Changed line 31 from:
User with small balance (zero stop):
to:
c) User with small balance (zero stop):
Added lines 323-329:
!!! Disconnect network cable (prior to copy job)
* While at login screen, disconnect network cable.
* Perform a copy job
* Leave a minute
* Reconnect network cable.
* Verify that after a few minutes the copy job is tracked in PaperCut.

Changed lines 310-311 from:
* Confirm you can login after the restart as completed
to:
* Confirm you can login after the restart is completed
Changed lines 350-351 from:
* Load the document feeder with a large document and start scanning.  Cancel scanning via cancel button and logout.  Endure job tracks/records as expected.
to:
* Load the document feeder with a large document and start scanning.  Cancel scanning via cancel button and logout.  Ensure job tracks/records as expected.
Changed lines 283-284 from:
* When the device is configured to point on a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.
to:
* When the device is configured to point to a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.
Changed line 294 from:
!!! Stop PaperCut Application Server during coping
to:
!!! Stop PaperCut Application Server during copying
Changed lines 350-351 from:
* Load the document feed with a large document and start scanning.  Cancel scanning via cancel button and logout.  Endure job tracks/records as expected.
to:
* Load the document feeder with a large document and start scanning.  Cancel scanning via cancel button and logout.  Endure job tracks/records as expected.
Changed lines 277-278 from:
* The device must provide a way to set a device name.  This will typically configured along with the server IP address.  The device name is used to identify the device in PaperCut.
to:
* The device must provide a way to set a device name.  This will typically be configured along with the server IP address.  The device name is used to identify the device in PaperCut.
Changed lines 280-281 from:
* When the device is configured to point on an invalid server IP address (e.g. an incorrect IP address).  A suitable error message should display. (e.g. Communication Problem: Unable to connect to server)
to:
* When the device is configured to point to an invalid server IP address (e.g. an incorrect IP address).  A suitable error message should display. (e.g. Communication Problem: Unable to connect to server)
Changed line 62 from:
* When users select "unrestricted" accounts the account balance is not relevant should not be presented to the user.  If some something is to be displayed it should be "unrestricted".
to:
* When users select "unrestricted" accounts the account balance is not relevant and should not be presented to the user.  If something is to be displayed it should be "unrestricted".
Changed lines 69-70 from:
In this organization teachers are used to selecting faculty accounts using PIN/codes and which to continue to use this convention at the copiers.  They are also not allowed to charge copying to their personal account and must selected a shared account via a code.
to:
In this organization teachers select faculty accounts using PIN/codes and continue to use this convention at the copiers.  They are also not allowed to charge copying to their personal account and must select a shared account via a code.
Changed lines 88-89 from:
The corporate user has their copies tracked, but they are not restricted from copying in anyway (tracking/auditing only).  They do not have access to charge to Shared Accounts.  All jobs are automatically charged/allocated to their personal account.
to:
The corporate user has their copies tracked, but they are not restricted from copying in any way (tracking/auditing only).  They do not have access to charge to Shared Accounts.  All jobs are automatically charged/allocated to their personal account.
Changed lines 154-155 from:
An organization uses secure print release to hold jobs in the print queue until the user releases the jobs are the device.  Note: This feature also applied to find-me printing (aka Follow-Me printing).
to:
An organization uses secure print release to hold jobs in the print queue until the user releases the jobs at the device.  Note: This feature also applies to find-me printing (aka Follow-Me printing).
Changed line 207 from:
* The user should be able login with a card without using pressing any keys on the device. i.e. they should not have to first select "card authentication", nor have to push "Enter/OK" after a card swipe.
to:
* The user should be able to log in with a card without pressing any keys on the device. i.e. they should not have to first select "card authentication", nor have to push "Enter/OK" after a card swipe.
Changed lines 215-216 from:
To prevent unauthorized card use when a card is stolen or lost, organizations may chose to implement two factor authentication (something you have plus something you know).  In PaperCut two factor authentication is implement via a numeric card PIN.
to:
To prevent unauthorized card use when a card is stolen or lost, organizations may chose to implement two factor authentication (something you have plus something you know).  In PaperCut two factor authentication is implemented via a numeric card PIN.
Changed lines 230-231 from:
* The user should be informed that the new PIN is assigned and devices access granted.
to:
* The user should be informed that the new PIN is assigned and device's access granted.
Changed lines 273-275 from:
The following tests cover security, exception and general tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.  Please record the result of each section below and allow adequate time to complete all tests.  These tests are some of the most important in the series and are often the ones the demonstrate problems with initial implementations.

to:
The following tests cover security, exception and general tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.  Please record the result of each section below and allow adequate time to complete all tests.  These tests are some of the most important in the series and are often the ones that demonstrate problems with initial implementations.

Changed lines 35-36 from:
* Confirm the copy job is stopped when the user's balance us used up.  '''NOTE:''' Some devices can stop the job before the job starts, other might stop the job part way through.
to:
* Confirm the copy job is stopped when the user's balance is used up.  '''NOTE:''' Some devices can stop the job before the job starts, others might stop the job part way through.
November 21, 2011, at 03:31 AM by tim - fix grammar/typos
Changed lines 5-6 from:
3rd party implementations must complete these test cases before being certified by PaperCut.  The 3rd party should complete the tests recording the results.  Where the implementation does not comply, an explanation for the non-compliance must be provided.  The testing procedure below is thorougher and detailed. Testers should look at dedicated at least one full day to this process and its documentation.
to:
3rd party implementations must complete these test cases before being certified by PaperCut.  The 3rd party should complete the tests recording the results.  Where the implementation does not comply, an explanation for the non-compliance must be provided.  The testing procedure below is thorough and detailed. Testers should look at dedicating at least one full day to this process and its documentation.
Added lines 285-289:
!!! Device automatic reconfiguration
* Make a price configuration change on the device in the PaperCut administration console.  Verify that the device auto detects this change within a minimum of 60 seconds.
* Change other configuration options that are statefully stored on the device (e.g. price line settings) and verify they are detected within 60 seconds.
-->[-(Note: It is acceptable for the device to trigger off a "reboot" to refresh it's settings.  This is often the simplest way to implement configuration change detection.)-]

Changed lines 273-275 from:
The following tests cover security, exception and general tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.

to:
The following tests cover security, exception and general tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.  Please record the result of each section below and allow adequate time to complete all tests.  These tests are some of the most important in the series and are often the ones the demonstrate problems with initial implementations.

Changed lines 280-281 from:
When the device is configured to point on an invalid server IP address (e.g. an incorrect IP address).  A suitable error message should display. (e.g. Communication Problem: Unable to connect to server)
to:
* When the device is configured to point on an invalid server IP address (e.g. an incorrect IP address).  A suitable error message should display. (e.g. Communication Problem: Unable to connect to server)
Changed lines 283-284 from:
When the device is configured to point on a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.
to:
* When the device is configured to point on a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.
Changed lines 279-284 from:
to:
!!! Invalid server
When the device is configured to point on an invalid server IP address (e.g. an incorrect IP address).  A suitable error message should display. (e.g. Communication Problem: Unable to connect to server)

!!! Invalid license
When the device is configured to point on a PaperCut MF server with no valid device licenses, the device should display a suitable message indicating a license is required (i.e. the message returned by the server's [@registerDevice@] call.

Changed lines 360-361 from:
[-keywords: certification, test plan, test cases, usecases -]
to:
[-keywords: certification, test plan, test cases, usecases, hardware terminal testing, copier controller testing -]
Added lines 360-361:
[-keywords: certification, test plan, test cases, usecases -]
Changed lines 3-4 from:
The following test cases are used to test, validate and/or certify PaperCut copier/device integration.  The use-cases and tests apply to both PaperCut in-house developed copier control solutions (such as embedded solutions) as well as solutions developed by 3rd parties using PaperCut's [[ExternalDataSourceAPI | Copier Control Terminal API]].
to:
The following test cases are used to test, validate and/or certify PaperCut copier/device integration.  The use-cases and tests apply to both PaperCut in-house developed [[http://www.papercut-mf.com/tour/|copier control solutions]] (such as [[http://www.papercut-mf.com/tour/track-copiers/|embedded solutions]]) as well as solutions developed by 3rd parties using PaperCut's [[ExternalDataSourceAPI | Copier Control Terminal API]].
Changed line 48 from:
* Change their account selection settings to "Show the Standard Account Selection Popop" and enable "personal account", "shared account with list" only.  Disable the "shared account with code" option.
to:
* Change their account selection settings to "Show the Standard Account Selection Popop" and enable "select shared account with list" only.  Disable the "personal" and "shared account with code" options.
May 03, 2011, at 11:36 AM by 124.170.39.75 -
Changed lines 272-274 from:
!! Test Case 13: Exception and Security Tests
The following tests cover security and
exception tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.
to:
!! Test Case 13: Exception, Security and General Tests
The following tests cover security,
exception and general tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.


!!! Device naming
* The device must provide a way to set a device name.  This will typically configured along with the server IP address.  The device name is used to identify the device in PaperCut.


March 24, 2011, at 11:06 PM by 202.129.124.120 -
Changed lines 5-6 from:
3rd party implementations must complete these test cases before being certified by PaperCut.  The 3rd party should complete the tests recording the results.  Where the implementation does not comply, an explanation for the non-compliance must be provided.  The testing procedure below is thorougher and detailed. Testers should look at dedicated at least one full day to this process and it's documentation.
to:
3rd party implementations must complete these test cases before being certified by PaperCut.  The 3rd party should complete the tests recording the results.  Where the implementation does not comply, an explanation for the non-compliance must be provided.  The testing procedure below is thorougher and detailed. Testers should look at dedicated at least one full day to this process and its documentation.

Test are designed around "real world" use cases and are outlined in detail below
.
March 24, 2011, at 11:03 PM by 202.129.124.120 -
Changed lines 3-4 from:
The following test cases are used to test, validate and/or certify PaperCut copier/device integration.  The use-cases and tests apply to both PaperCut in-house developed copier control solutions (such as embedded solutions) as well as solutions developed by 3rd parties using PaperCut's [[ExternalDataSourceAPI | Copier Terminal API]].
to:
The following test cases are used to test, validate and/or certify PaperCut copier/device integration.  The use-cases and tests apply to both PaperCut in-house developed copier control solutions (such as embedded solutions) as well as solutions developed by 3rd parties using PaperCut's [[ExternalDataSourceAPI | Copier Control Terminal API]].
Added lines 353-355:
----
''Categories:'' [[Category.API|+]]
----
Changed lines 5-7 from:
3rd party implementations must complete these test cases before being certified by PaperCut.  The 3rd party should complete the tests recording the results.  Where the implementation does not comply, an explanation for the non-compliance must be provided.

to:
3rd party implementations must complete these test cases before being certified by PaperCut.  The 3rd party should complete the tests recording the results.  Where the implementation does not comply, an explanation for the non-compliance must be provided.  The testing procedure below is thorougher and detailed. Testers should look at dedicated at least one full day to this process and it's documentation.
Changed lines 5-7 from:
to:
3rd party implementations must complete these test cases before being certified by PaperCut.  The 3rd party should complete the tests recording the results.  Where the implementation does not comply, an explanation for the non-compliance must be provided.

Changed lines 3-5 from:
The following test cases are used to test, validate and/or certify PaperCut copier/device integration.  The use-cases and tests apply to both PaperCut in-house developed copier control solutions (such as embedded solutions) as well as solutions developed by 3rd parties using PaperCut's Copier Terminal API.

to:
The following test cases are used to test, validate and/or certify PaperCut copier/device integration.  The use-cases and tests apply to both PaperCut in-house developed copier control solutions (such as embedded solutions) as well as solutions developed by 3rd parties using PaperCut's [[ExternalDataSourceAPI | Copier Terminal API]].

Deleted line 2:
! Introduction
Added lines 1-352:
(:title External Device Test Cases :)

! Introduction
The following test cases are used to test, validate and/or certify PaperCut copier/device integration.  The use-cases and tests apply to both PaperCut in-house developed copier control solutions (such as embedded solutions) as well as solutions developed by 3rd parties using PaperCut's Copier Terminal API.


! Test Cases
!! Test Case 1: Student user

A student is restricted in the amount of printing and copying that can perform.  This user will not have access to shared accounts.  They can only charge to their personal account.

!!! Setup
* Setup a student test user in PaperCut
* Set the user to be "restricted"
* Set the device copy cost (e.g. $0.10 per page)

!!! Tests
User has credit balance:
* Allocate the user a small balance. E.g. $2.00
* Login as the student user.
* Perform some copying (or scanning/faxing if supported)
* Verify that the job is logged correctly in PaperCut.

User has no balance:
* Set the user's balance to zero.
* Try logging in as the student
* User should be denied copy access with an understandable message (insufficient funds).

User with small balance (zero stop):
* Set the user's balance to a small value.  E.g. $0.50
* Login as the user
* Perform a copy that will cost more than their balance
* Confirm the copy job is stopped when the user's balance us used up.  '''NOTE:''' Some devices can stop the job before the job starts, other might stop the job part way through.

'''Notes for ideal implementation:'''
* For "restricted" users, their account available balance should be displayed to them after successful login or throughout copier usage.


!! Test Case 2: Teacher user

A teacher has access to charge copies to two faculty accounts "Science" and "Maths".  They can also charge printing to a personal account which is unrestricted.

!!! Setup
* Setup a teacher test user in PaperCut
* Set the teacher user to "unrestricted"
* Change their account selection settings to "Show the Standard Account Selection Popop" and enable "personal account", "shared account with list" only.  Disable the "shared account with code" option.
* Create two accounts "Science" and "Maths" and grant this user access to these accounts (through Account->Security).

!!! Tests
* Login to the device as the teacher user.
* The user should be prompted for the account to charge their copying.  They should be able to select the accounts from a list.  The list be:
** Personal Account
** Science
** Maths
* Once the account is selected perform some copies.
* Confirm that the job is logged correctly in PaperCut and was charged to the selected account.
* Repeat this test selecting each account option in turn.  Confirm jobs are logged correctly.

'''Notes for ideal implementation:'''
* When users select "unrestricted" accounts the account balance is not relevant should not be presented to the user.  If some something is to be displayed it should be "unrestricted".
* When users select "restricted" accounts the account balance should be displayed to the user.
* When users have a small number of accounts then it's preferable to minimize the number of steps.  It is not appropriate to provide an "Account search" option when the list is so short.  When there is a small number of accounts it is recommend to simply display them in a selectable list format.
* When a "default shared account" is set for the user, the user interface should change to make this account easy to select with minimal steps/presses.  i.e. it might appear at the top of the account list so it can be selected with one click.


!! Test Case 3: Teacher user (pin/code account selection)
In this organization teachers are used to selecting faculty accounts using PIN/codes and which to continue to use this convention at the copiers.  They are also not allowed to charge copying to their personal account and must selected a shared account via a code.

!!! Setup
* Setup a teacher test user in PaperCut
* Set the user to be "unrestricted"
* Change their account selection settings to "Show the Standard Account Selection Popop" and enable "personal account" and "shared account with pin".  Disable the  "shared account with list" and "personal account" options.  Disable the "shared account with code" option.
* Set the PIN/codes on the previously created accounts as follows:
** Science: set code to 1111
** Maths : set code to 2222

!!! Tests
* Login to the device as the teacher user.
* The user should be prompted to enter the account PIN/code.
* Select account 1111 and perform some copies
* Confirm that the job is logged correctly in PaperCut and was charged to Science.
* Repeat the proceeding two steps for account 2222.
* Repeat for account 3333 (invalid account).  Confirm that a suitable error message displays.

!! Test Case 4: Corporate user
The corporate user has their copies tracked, but they are not restricted from copying in anyway (tracking/auditing only).  They do not have access to charge to Shared Accounts.  All jobs are automatically charged/allocated to their personal account.

!!! Setup
* Setup a  corporate user in PaperCut (e.g. coperateuser)
* Set the user to "unrestricted"
* Set their "Account Selection" settings to "Automatically charge to personal account"

!!! Tests
* Login to the device as the corporate user
* After login the copier should be enabled for use.
* Perform some copying.
* Confirm that the job is logged correctly in PaperCut.

'''Notes for ideal implementation:'''
* In this scenario the objective is to grant the user copier/device access with as minimal user interaction as possible.  The aim is to keep user steps to a minimum.

!! Test Case 5: Professional user (Engineering Company)
An engineering company allocates all printing and copying costs to client and project accounts.  With over 5000 accounts to choose from they need to find the account efficiently via keyword search (search and review).  For example, list all accounts and sub-accounts for "acme inc".

!!! Setup
* Configure the "[Template Account]" to grant access to the "[All Users]" group.  This ensures all users have access to all new accounts created.
* Use the bulk account import feature to import 5000 shared accounts. TIP: Use Excel to create a spreadsheet with 5000 accounts named: account0001, account0002, account0003, etc.  Then save the spreadsheet as a tab-delimited file to upload into PaperCut.  See https://www.papercut.com/products/ng/manual/ch-shared-accounts-import-update.html for information on import file format and procedure.
* Setup the professional user's "Account Selection" settings to be "Show the Advanced Account Selection popup" and disable the "Allow to charge to their personal account" option.

!!! Tests
* Login to the device as the professional user
* The user should be prompted for the account to charge their copying.  They must have:
**  the option to select account by pin/code
** the option to select accounts from a list.
** And importantly, the option to search for the account by name
* Select the "Search" option and try the following searches:
** Search for "111".  This should return about 14 accounts if the accounts were created as above.
** Search for "1234". This should return a single account "account1234".
** Search for "acc".  This will return all 5000 accounts.  The device should handle this gracefully by paging through the results (not retrieving all results at once).
* Select an account and perform copying
* Confirm that the job is logged correctly in PaperCut and was charged to the selected account.

'''Notes for ideal implementation:'''
* When a user has access to many accounts it is of little use to display a very long list.  The user should first be presented with the option to choose how to search for an account (e.g. by pin/code by name, etc)
* When performing the account searches, a reasonable amount of account results should be requested (e.g. only 100).  If the user pages through all these results the device can then request additional results.
* The user should be offered a method to scroll through the list of accounts.
* When a "default shared account" is set for the user, the user interface should change to make this account easy to select with minimal steps/presses.  i.e. it may appear as an option in the same screen as where the account search is provided.


!! Test Case 6: User with New Card
Users use swipe cards for authentication.  The user is issued a new card and they should be able to associate the card with their user account at the device (self association).

!!! Setup
* Remove any previous card number from your test user in PaperCut. Do this by selecting the user and clearing the "Card/Identity Number" field.
* Make sure that the test card number is not associated with any other users.
* In PaperCut configure the device as follows:
** Enable card authentication.
** Enable the "Enable self-association with existing user accounts" option under card authentication.

!!! Tests
* Attempt to login by swiping the card
* The device should inform the user that the card is not known to the system, and ask if they wish to associate the card with their account (e.g. Yes/No).
* If the user proceeds the user should be prompted for their username/password.  Enter a valid username and password.  The device should indicate that association was successful.
* The device should then take them back to the initial login screen to re-swipe the card.
* Repeat these test and ensure an invalid username/password does not allow association and feedback is appropriate.

'''Notes for ideal implementation:'''
* When a card is not known to the user the user should be prompted whether they would like to associate a card.  This should not happen without the user accepting this step.


!! Test Case 7: Secure Print Release
An organization uses secure print release to hold jobs in the print queue until the user releases the jobs are the device.  Note: This feature also applied to find-me printing (aka Follow-Me printing).

!!! Setup
* In PaperCut, enable the "Hold/Release Queue" on a test print queue.
* For the device, enable the "Print Release" option
* Select the print queue configured above under the "Displays jobs for release from the selected queues" option.
* Ensure the "Automatically release user's jobs upon login" option is disabled.
* Print some test jobs to the queue and confirm the jobs are listed in "Printers->Jobs Pending Release".  If the jobs are listed here they will be ready to release on the device.

!!! Tests
* Login to the device as the user that printed the jobs waiting for release.
* The user should be prompted to select to use the copier or release print jobs.
* When user selects to release print jobs they should be displayed a list of jobs to release.
* As jobs are released they should be printed and logged in PaperCut
* If jobs are cancelled, the job should not print.

The ideal implementation does depend on the amount of space and GUI options available on a given device.


'''Notes for ideal implementation:'''
* When giving the user the option to select between copying and print release it is recommended to display the number of currently held jobs to the user.  E.g "Print release (3 jobs)"
* Users should have the option to both print and cancel jobs awaiting release.
* There is a lot of information about the jobs being held (e.g. doc name, user, client machine, time, pages, cost, etc).  Ideally all these attributes would be visible to the user, but on constrained devices this may not be possible.  The most important attribute to display for print release is the document name. 


!! Test Case 8: Secure Print Release (auto release enabled)
An organization uses secure print release to hold jobs in the print queue.  When the user logs into the device they want all jobs to be released automatically upon successful login.

!!! Setup
* Setup PaperCut as per Test Case 7: Secure Print Release.
* In the device configuration enable the option "Automatically release user's jobs upon login".  This can be found under the device's print release settings.

!!! Tests
* Login to the device as the user that printed the jobs waiting for release.
* The login will trigger the jobs to be release.  If jobs have been released the user should be informed by a brief message.
* The device should then take the user through the standard copier process and not display an option to copy/release because the user's jobs will already be released.

'''Notes for ideal implementation:'''
* The message displayed on login if jobs are released should ideally indicate the number of jobs released.

!! Test Case 9: Lost card (alternate login methods)
User in this scenario normally authenticate with cards, however users should also be able to login with alternate login methods.  This is useful when user has misplaced their card (e.g. left their card at home).  An alternate login method, all be it less convenient, will ensure the user still has copying and secure print release access.

!!! Setup
* In PaperCut enable both the "swipe card" and "username and password" authentication.
* Make sure your test user has the card number set to the number of your test card.

!!! Tests
* When the user approaches the device they should be able to login with either card or username/password.
* Test that the user can successfully login with a card.
* Test that the user can successfully login with a username and password.

'''Notes for ideal implementation:'''
* The user should be able login with a card without using pressing any keys on the device. i.e. they should not have to first select "card authentication", nor have to push "Enter/OK" after a card swipe.
* The interface should guide the user to the options available.  The interface will depend on the capabilities of the device.  On a limited display device the screen might show "Swipe card or press X to enter username/password".  On a graphic/touch screen the alternate login options may be presented as buttons.
* The interface should where possible support all authentication methods:
** Card Swipe
** Username and password
** ID and PIN

!! Test Case 10: Two Factor Authentication
To prevent unauthorized card use when a card is stolen or lost, organizations may chose to implement two factor authentication (something you have plus something you know).  In PaperCut two factor authentication is implement via a numeric card PIN.

!!! Setup
* In PaperCut, enable the "Swipe card" authentication for the device.
* Enable the "Require PIN" option under the "Swipe Card" option.
* Setup the test user:
** Ensure the user has credit/balance on their account.
** Ensure a test card number is entered in the test user's "Card/Identity Number" field
** Ensure the the "Card/ID PIN" field is clear/empty.  This will cause the device to request a new PIN on first use.

!!! Tests

Test for user without a PIN (define new PIN on first-use):
* Swipe the test card at the device.
* The user should be prompted to enter a new PIN.  They should also be asked to confirm the new PIN to ensure it was correctly entered.
* The user should be informed that the new PIN is assigned and devices access granted.

Test for user with a PIN:
* Now that the user has been assigned a PIN (in the previous test), swipe the card at the device again.
* The device should prompt for the PIN number.
* Enter a correct PIN number and ensure device use is granted.
* Enter an invalid PIN number and ensure devices access is denied.

'''Notes for ideal implementation:'''
* Where possible the user interface should adapt based on whether a PIN is required.
* Message should appear on the screen helping the user understand why they have been requested for a PIN.  Suggested text:  "Please enter a new PIN number to associate with your card."
* If using "ID" authentication the user interface should only request a PIN number if one is required.  On GUI interface this might mean there is no PIN field if a PIN is not required.
 
!! Test Case 11: Account tracking only (auto login)
A company wants to charge printing to accounts, but is not interested in tracking copying at the individual user level.  It is more important for them to speed up access to the copier by not requiring that users login.

!!! Setup
* Create a test user called "copieruser".
* In PaperCut under the device's authentication option, enable the "Automatically login as user"  option.
* Enter the name "copieruser".  All jobs will be tracked against this user.
* Under Users, select "copieruser".  Change the Account Selection options to "Show the standard account selection popup". Enable the "select shared accounts (from list)" option and disable all other options.
* Ensure copier user has access to at least two Shared Accounts (e.g. Shared Accounts -> Account  Details –> Security)

!!! Tests

User with account selection:
* The device should no longer prompt for login.
* The user should be presented with the account selection options.
* Select an account and perform copying
* Verify that the job was logged correctly.  The job should be charged to the selected account and associated with the "auto login" user.

No account selection:
* Change the "copieruser's" account selection option to "Automatically charge to personal account"
* When using the device there should be no login or account selection to enable the copier.  The device may request the user to press a button to proceed and enable the copier).

'''Notes for ideal implementation:'''
* If there is account selection enabled, then the device should send the user straight to the account selection screen without any user interaction.  It may for example be appropriate to simply display a "start" button rather than offer a login interface.
* If there is no account selection (e.g. automatically charge to personal account) the device may display an initial prompt for the user to enable the copier.  E.g. "Press to begin".

!! Test Case 12: Fax and Scan Tests
If the integration is designed to target/track Fax and Scan usage, the above test cases (at least the major ones) should be repeated for these event types.

!! Test Case 13: Exception and Security Tests
The following tests cover security and exception tests.  The focus is on tricky corner cases that may show up bugs or unexpected behavior in real-life environments.

!!! Large copy job
* Perform a 100 page copy job ... allow it to complete and confirm it's logged correctly.
* Start a 500 page copy job .... cancel it after 10-ish pages copied and confirm it's logged correctly.

!!! Stop PaperCut Application Server during coping
* Start a large copy job (suggested 100 pages).
* While in progress stop the PaperCut application server (e.g. Services -> PaperCut Application Server -> Stop).
* Wait for job to complete, etc.
* Restart the Application Server a few minutes later, and confirm that the job is logged correctly.

!!! Hard power-off during copy
('''NOTE:''' don't do this too often may be not good for device)
* Start a large copy job.
* After about 10 pages , hard power off the device (e.g. power off at the power point).
* Note the number of pages actually produced.
* Restart the device.
* Confirm that the pages are counted correctly (within reason as some may still be half stuck in the device).

!!! PaperCut Application Server restart test
* While device is displaying idle/login screen restart the PaperCut application server
* Confirm you can login after the restart as completed

!!! Disconnect network cable (while trying login)
* While at login screen, disconnect network cable.
* Try logging in, etc. Confirm that it handles the error gracefully (e.g. displays a reasonable error).
* Reconnect network cable.
* Try logging in again and confirm that all works as expected.

!!! Disconnect network cable (leave idle)
* While at login screen, disconnect network cable.
* Leave device idle for 10 minutes (do not login).
* Reconnect network cable.

!!! No network at power on
* Turn off device.
* Disconnect network cable.
* Restart the device.
* Confirm that the application displays a reasonable message when network disconnected.
* Reconnect the network cable.
* Confirm the device connects and you can login.

!!! Card reader stability (for removable USB card readers)
* Plug in card-reader and confirm it's working (e.g. login).
* Unplug the USB card-reader.
* Leave for a couple of minutes.
* Reconnect the card-reader.
* Test whether it works or confirm a reasonable error message is displayed.

!!! Overnight idle test
* Confirm the device standby/power-save timeout is enabled.
* Plug in card-reader and confirm it's working (e.g. login).
* Leave device on overnight (or for a period longer than the standby timeout) while connected to PaperCut.  Some devices have various sleep phases.  Suggest leaving overnight for a complete test.
* In the morning test login (including the card reader) and ensure everything works as expected.

!!! Scan exception testing
* Verify that scan tracking works for all possible storage cases:
** Scan to email
** Scan to network file store
** Scan to device document store
** Scan to locally connected USB media
* Load the document feed with a large document and start scanning.  Cancel scanning via cancel button and logout.  Endure job tracks/records as expected.

!!! Fax exception testing
* Verify that a Fax job with an invalid phone number does not charge
* Verify that a delayed Fax job eventually logs.  E.g. Unplug phone cable for 10 minutes, reconnected and ensure the job logs when finally completes.

!!! Cross-platform Testing
* If your solution/device communicates with the PaperCut server through any other protocol, port, or method other than those recommended by PaperCut, then the solution should be tested on all platforms.

!!! Verify encrypted traffic
* Install Wireshark ( http://www.wireshark.org/ ) or equivalent on the system running the PaperCut Application Server
* Enable logging of all traffic between the server and the test devices
* Conduct a card swipe login
* Verify that the card number was not passed in clear text (e.g. search packet content using Wireshark search)
* Conduct a username and password login
* Verify password was not passed in the clear.

!!! Arrange independent security review
* All certified solutions that are intended to be deployed in an education environment must be independently audited.  Please contact PaperCut support to arrange.

Comments

Share your findings and experience with other PaperCut users. Feel free to add comments and suggestions about this Knowledge Base article. Please don't use this for support requests.

Article last modified on March 18, 2019, at 07:22 AM
Printable View   |   Article History   |   Edit Article