WS (Fork and non-scheduler-specific tests performed for each release candidate, otherwise only once per release cycle)

ruly.mcs.anl.gov
submit205 "Bad Substitution" Failed
submit208 "Relative directory test" Failed (globusrun-ws output: globusrun-ws: Job failed: Invalid directory path "tmp".)

lucky0.mcs.anl.gov
submit002 "False" Failed (exit code not propagated from scheduler)
submit003 "Check Exit Code" Failed (exit code not propagated from scheduler)
submit205 "Bad Substitution" Failed
submit208 "Relative directory test" Failed (globusrun-ws: Job failed: Invalid directory path "tmp".)
failure005-008 "Unwritable std*" Failed

lucky0.mcs.anl.gov
submit003 "Check Exit Code" Failed
submit004 "Test multiple arguments" Failed
submit201-205 "* substitution" Failed (Condor quoting issue)
submit206 "relative path to executable" Failed
submit208 "Relative directory test" Failed (globusrun-ws: Job failed: Invalid directory path "tmp".)
failure001 "Executable does not exist" Failed
failure003 "Directory does not exist" Failed
failure005-008 "Unwritable std*" Failed
failure009-010 "stdin *" Failed

Hangs in staging states caused by StateMachine and RFT bugs.
Fixes committed to gram_recoverability_tester_branch and will be available in 4.0.1.

WS Performance (performed once per release cycle, usually after the release candidate)

RESULT SUMMARY: Throughput peaks at 74 jobs per minute (1.23 jobs per second) for 2 client threads, each running with a load of 8. The throughput starts out at about twice that for 3.9.5 with 1 client thread, but drops off and errors out (OutOfMemoryError on server) earlier.

RESULT SUMMARY: With a reasonable margin of error, the results for shared delegation are identical to those of no delegation.

RESULT SUMMARY: Throughput peaks at 11 jobs per minute (0.183 jobs per second) for a range of cases. These results can not be compared with the partial results obtained for earlier releases since different numbers of staging operations were done.

bullet key

color key
Test has not completed
Test completed successfully
Test completed with partial success
Test failed