software-name: UA_DUtools (UA_DUtools-v?.?.tar.Z) description: DU management scripts, programs, and docs. Miscellaneous tools for Digital UNIX systems management including patch file deconsolidation and installation; uerf and dia filters; hsz40 management; uaio (iostat) to properly support hsz40 device naming; uals enhanced ls; automated dsn fetches; uakpacct for quickly extracting information from acct files; clean system shutdown automation; documentation on recovery techniques, disk firmware, etc.; some Oracle management scripts; etc. registered-by: snkac@ts.sois.alaska.edu (Kurt Carlson, University of Alaska) pointer: ftp://ftp.alaska.edu/pub/sois ftp the current version of: ftp://ftp.alaska.edu/pub/sois/UA_DUtools.tar.Z (link to kits/UA_DUtools-vX.Y.tar.Z) then: uncompress UA_DUtools.tar.Z tar xvf UA_DUtools.tar and read UA_DUtools_kit/README for more information. ........................................................................ Note, separate kits now exist for: ftp://ftp.alaska.edu/pub/sois/uaio.tar.Z ftp://ftp.alaska.edu/pub/sois/uak.tar.Z ftp://ftp.alaska.edu/pub/sois/uals.tar.Z ftp://ftp.alaska.edu/pub/sois/uakpacct.tar.Z These kits have been copied into the UA_DUtools kit, but to ensure you have the most current versions check the modify dates of all the *.Z kits. If you have problems, please contact fnkac@uaf.edu or kcarlson@arsc.edu. ........................................................................ Quick install template (from 20 Oct 1999, 991020) on DU 4.0D: # #ftp ftp.alaska.edu:/pub/sois/UA_DUtools.tar.Z # linked to v2.2 # uncompress UA_DUtools-v2.2.tar.Z # tar xf UA_DUtools-v2.2.tar # cd UA_DUtools-v2.2; ls -l # #Installing to $HOME, must be suitably privileged for /usr/local # #if needed will mkdir $HOME/bin,include,lib,man/man1,man3,man8: # #krcp UA_DUtools-v2.2.tar.Z fnkac@raven.alaska.edu:u # ./ua_make.ksh uak installextras $HOME # ./ua_make.ksh uakpacct install $HOME # ./ua_make.ksh uals install $HOME # ./ua_make.ksh uaio install $HOME # Digital Unix specific # cd $HOME # Review what got installed: # uals -Zz bin man/man? lib include | grep 991020 - 0755 fnkac users 40k 991020.0955 bin/ibmlabel - 0755 fnkac users 40k 991020.0955 bin/loan - 0755 fnkac users 40k 991020.0955 bin/lockit - 0755 fnkac users 48k 991020.0955 bin/sgiprods - 0755 fnkac users 32k 991020.0955 bin/sik - 0755 fnkac users 40k 991020.0959 bin/ua_date - 0755 fnkac users 40k 991020.0955 bin/ua_hosts - 0755 fnkac users 48k 991020.0959 bin/ua_oraio - 0755 fnkac users 48k 991020.0959 bin/ua_uerf - 0755 fnkac users 40k 991020.0955 bin/uafdump - 0755 fnkac users 32k 991020.0959 bin/uafuser - 0755 fnkac users 72k 991020.0959 bin/uaio - 0755 fnkac users 40k 991020.0955 bin/uakce - 0755 fnkac users 40k 991020.0955 bin/uakdf - 0755 fnkac users 40k 991020.0955 bin/uakebcpd - 0755 fnkac users 40k 991020.0955 bin/uakid - 0755 fnkac users 48k 991020.0956 bin/uaklogin - 0755 fnkac users 40k 991020.0959 bin/uakmknod - 0755 fnkac users 72k 991020.0956 bin/uakpacct - 0755 fnkac users 72k 991020.0958 bin/uals - 0755 fnkac users 32k 991020.0959 bin/uashodev - 0755 fnkac users 32k 991020.0955 bin/uawhich - 0755 fnkac users 24k 991020.0955 bin/whois - 0644 fnkac users 17k 991020.0955 include/etoa.h - 0644 fnkac users 5113 991020.0955 include/ua_get_ps.h - 0644 fnkac users 526 991020.0955 include/ua_time.h - 0644 fnkac users 993 991020.0955 include/ua_utmp.h - 0644 fnkac users 1402 991020.0955 include/uaccilib.h - 0644 fnkac users 394 991020.0955 include/wldcmp.h - 0644 fnkac users 47k 991020.0955 lib/libcci.a - 0644 fnkac users 4210 991020.0955 man/man1/ibmlabel.1 - 0644 fnkac users 7852 991020.0955 man/man1/loan.1 - 0644 fnkac users 2241 991020.0955 man/man1/lockit.1 - 0644 fnkac users 3286 991020.0955 man/man1/sgiprods.1 - 0644 fnkac users 1361 991020.0955 man/man1/sik.1 - 0644 fnkac users 5461 991020.0959 man/man1/ua_date.1 - 0644 fnkac users 3726 991020.0955 man/man1/uafdump.1 - 0644 fnkac users 3474 991020.0955 man/man1/uakce.1 - 0644 fnkac users 2036 991020.0955 man/man1/uakdf.1 - 0644 fnkac users 2313 991020.0955 man/man1/uakebcpd.1 - 0644 fnkac users 3151 991020.0955 man/man1/uakid.1 - 0644 fnkac users 13k 991020.0958 man/man1/uals.1 - 0644 fnkac users 3682 991020.0955 man/man1/uawhich.1 - 0644 fnkac users 1844 991020.0955 man/man1/whois.1 - 0644 fnkac users 12k 991020.0955 man/man3/libcci.3 - 0644 fnkac users 7780 991020.0959 man/man8/ua_oraio.8 - 0644 fnkac users 15k 991020.0959 man/man8/ua_uerf.8 - 0644 fnkac users 11k 991020.0956 man/man8/uacrep.8 - 0644 fnkac users 11k 991020.0956 man/man8/uadrep.8 - 0644 fnkac users 1708 991020.0959 man/man8/uafuser.8 - 0644 fnkac users 12k 991020.0959 man/man8/uaio.8 - 0644 fnkac users 15k 991020.0956 man/man8/uaklogin.8 - 0644 fnkac users 4770 991020.0959 man/man8/uakmknod.8 - 0644 fnkac users 15k 991020.0956 man/man8/uakpacct.8 - 0644 fnkac users 11k 991020.0959 man/man8/uashodev.8 # #That's it, use 'man -M $HOME/man ' # #See the README.*'s for other information ........................................................................ Some additional utilities can be found on ftp, look under: ftp://ftp.alaska.edu/pub/sois/ ftp://ftp.alaska.edu/pub/randy/ ______________________________________________________________________________ Change History: -------------- v2.7 2002-10-05 kac *** FINAL ANTICPATED REGNERATION OF UA_DUtools KIT *** uaio-2.4 No changes except kit cleanup uak-v3.0 ua_get_ps() 'retired', better version in uakpacct kit; SX6 support; uakpacct-v3.8 uaps added; uaklogin enhanced; aix validated uakpacct; SX6 support; uals-v2.8 SX6 support; kit cleanup v2.6 2002-04-05 kac *** FINAL ANTICPATED REGNERATION OF UA_DUtools KIT *** uaio-2.3t2 Builds on Tru64 5.1 uak-v2.8 No changes uakpacct-v3.5 Additional Cray csa script updates uals-v2.6a Minor enhancements and bug fixes The DU_tools were built under DU 4.0 and may not be applicable to Tru64 5.x. I anticipate no further updates to the UA_DUtools distribution since I no longer work directly on Tru64 systems. The individual kits are being updated for the platforms I work on (Unicos[/mk], IRIX, AIX, Linux, Solaris) and do get tested and rebuilt on Tru64 as my time permits. v2.5 2001-01-20 kac uaio-2.2 No changes (still not built for DU 5.0) uak-v2.8 Solaris, Linux, AIX builds; 'uakce -Edit' uakpacct-v3.4 Solaris, Linux, AIX builds; Cray csa updates uals-v2.5 Solaris, Linux, AIX builds; correct -Et v2.4 2000-01-15 kac uak-v2.5 Add df-h & dfk examples; minor enhancements uakid & ua_date uakpacct-v3.1 No changes uaio-v2.2 Correct date display (modulo 100) in uaio and uashodev uals-v2.2 No changes v2.3 2000-01-04 kac uak-v2.5 y2k fix to ua_date (and minor enhancements) uakpacct-v3.1 Cray accounting example enhancements uaio-v2.1b No changes uals-v2.2 No changes v2.2 1999-10-20 kac distribution revisions to accomodate raven upgrade. re-did quick install template (make sure it still works). uaio-v2.1b minor correction to -D (debug) display. uak-v2.4 add lockit, whois uakpacct-v3.0 uaklogin add =pid, -terminal uakpacct add -tty, -80; corrections & examples/t3e cleanup uals-v2.2 minor corrections; whois to uak's kit; nominal acl support v2.1 990517 snkac create links to kits and copy man *.html pages: uaio-v2.1a no other changes uak-v2.2 enhance uawhich, libcci ua_arg; add loan.1 and sik.1 pages uakpacct-v2.9 minor corrections (see README.uakpacct). uals-v1.9 no other changes v2.0 990216 snkac uaio-v2.1a no changes uak-v2.1 Irix 6.5 changes; correction to uakid uakpacct-v2.8 Irix 6.5 changes uals-v1.9 Irix 6.5 changes v1.9a 990122 snkac uaio-v2.1a audit and some other examples were moved from DUtools/doc to uaio kit. v1.9 981026 snkac uakpacct-v2.7 Numerous Cray accounting enhancements, general minor enhancements (see README.uakpacct). uaio-v2.1 No change. uak-v1.9 Minor enhancments to uafdump, ua_date, find_uid(); Added efopen_umask(). uals-v1.8 Added some aliases; included sample whois source. v1.8 980411 snkac uakpacct-v2.2 uafuser and ua_uerf moved to uaio kit (DU specific stuff). uaio-v2.1 Now contains ua_user and uafuser. uak-v1.7 Minor enhancements, now has ua_date uals-v1.7 No change. v1.7 980403 snkac uakpacct-v2.1 Support for Cray CSA accounting record interpretation. uaio-v2.0b Enhanced device recogniztion under DU v4.0b. uak-v1.6 Minor enhancements, find_uid() added. uals-v1.7 No change. 980403 snkac added du/doc/analsys/audit* audit examples & doc since this has been asked for several times. 980328 snkac move du 'specific' stuff under du directory, this effectively cleans up directory as an install base. rename rebuild.* files as .rebuild.* so don't have to see 'em. v1.6 980218 snkac uaio-v1.9 see README.uaio, minor cosmetic changes (don't have a DU v4.0d system to test on yet) uak-v1.5 see README.uak: Added: uafdump, sgiprods, loan, sik, ibmlabel; man libcci; uawhich -ls option uakpacct-v1.8 see README.uakpacct, minor corrections uals-v1.7 see README.uals, some Unicos specific enhancements v1.5 971231 snkac uak-v1.1.tar.Z add ua_dlm_list(),ua_chk_list(),uakebcpd; include cci/Makefile for libcci.a creation. uakpacct-v1.6.tar.Z uaklogin use ua_*_list() & ensure headers with -pid. uals-v1.6.tar.Z no change 'cept compile w/out -g (not needed). v1.4 971113 snkac added 'quick install template' to readme (from test install) s./bin/ksh./usr/bin/ksh. in ua_make.ksh. rcp ua_make.ksh to ftp (for individual kits) 971110 snkac uakpacct-v1.5 (minor changes) minor cleanup in other kits. v1.3 971105 snkac uals-v1.5a now a sub-kit w/source based on gnu ls uak-v1.0 now a sub-kit uakpacct-v1.4a uaio-v1.8a Packaging changes: uals and uak are now sub kit (tar files) in this kit. uals is now based on gnu source vs. Digital UNIX, source included. Four sub-kit's included: uaio, uak, uals, uakpacct un-tar the kits and see individual README files. Note, since I no longer directly support Digital UNIX (now supporting IRIX and UNICOS), non-sub-kit examples under ./src, ./job, etc. are frozen at their current state effective 09/15/1997, they were operable then. The sub-kit software is being maintained. With the exception of uaio the sub-kit software has been ported to also run under IRIX 6.2 and UNICOS 9. To install sub-kits use (examples): # ./ua_make.ksh uak install /usr/local # ./ua_make.ksh uals install /usr/local # ./ua_make.ksh uakpaccct install /usr/local # ./ua_make.ksh uaio install /usr/local 971005 snkac uakid v1.3 for IRIX use utmpx file so we can get logon host; #ifdef __osf__ to remove -lid for non-Digital UNIX. 970927 snkac uakce v1.2 add -backspace option to filter backspace and preceeding. 970927 snkac uakpacct-v1.4 uaklogin -userid and -both added; IRIX (sgi): use utmpx, add !x, and corrections. v1.2 970913 sxkac uakpacct-v1.3 added Makefile and Makefile.other for selected source. v1.1 970912 sxkac uaio-v1.8.tar.Z and uakpacct-v1.2.tar.Z are both now kits within UA_DUtools Note, uakpacct includes uaklogin, uafuser, ua_uerf, & ua_date. Reference separate README files for those kits. v1.0 sxkac never bothered to generate this kit due to the emergence of uakpacct|uaklogin|uafuser|ua_uerf into a separate kit. v0.9 970818 sxkac uashodev (1.3 via disk_info.c) add display of bus and controller information 970815 sxkac uaio (1.3 and disk_info.c) support for swxcr devices under both DU v3.x and v4.0. thanks to: Keith Lewis Thomas Erskine Abdon <71055.111@compuserve.com> Andrew Greer Stephen Cooper Judith Reed ______________________________________________________________________________ 970726 sxkac v0.8 970726 sxkac uaio (1.2): reduce narrow display from 19 to 18 disks so fits in 132 cols. 970713 sxkac atlanta_ftp.ksh: switch to ftp.service.digital.com format 970613 sxkac uaio (1.1): add -w option to display when (timestamp) vs. totals in the vertical display. changed uaio.ksh to utilize 100 second interval with 36 iterations (still 1 hour) for easier mental tps calculation. 970613 sxkac uakmknod: moved source to uaio directory and wrote man page (finally). ______________________________________________________________________________ 970604 sxkac v0.7 970604 sxkac uaio + ua_oraio: ua_oraio moved under uaio directory (and documented); uaio.v0.9.tar.Z kit created; minor corrections documented in uaio.c history log. 970516 sxkac uakpacct: clean up block read/write and character io display; character io now displays as mega vs. kilo since every process typically has 500,000+ overhead; add -cio and -brw threshhold options; default to no group lookup (much more efficient); add -lookup to lookup gid->group; add multiple group and !group lookups; for userid or group matches, get uid|gid exactly once for greater (much!) efficiency; move any required gid->group or uid->userid as last thing prior to printing record (more efficient). ______________________________________________________________________________ 970515 sxkac v0.6 970515 sxkac uaiostat: (now uaio) program rewritten as uaio additional options added. uaio and uashodev are now in a separate tar kit: ftp://ftp.alaska.edu/pub/sois/uaio.v0.7.tar.Z since it was written from scratch, source included there (as well as here under src/uaio). 970506 sxkac purges.ksh: script for doing scheduled file cleanup from parameter file. see the 'purges' parameter file as an example. 970505 sxkac uakcdi: distinguish NAS table and recognized 'removed' table. 970501 sxkac ua_shutdown.ksh allow for rsh execution for scheduler agent-less nodes (e.g., under DU v4.0). 970429 sxkac atlanta_ftp.ksh script to obtain patches... updated for obtaining and reviewing the setld kits (patches.tar). notes on installing patch kits under doc/unix/patch_kit. the patch_setup and patch_apply functions were updated for safely de-installing local patches. 970424 sxkac uakpacct: add -Start option (for -mgmt) to display start date if = end; needed for cpu_consumers script to find *long* jobs. cpu_consumers.ksh is included. 970423 sxkac uakcdi: add -all option to show all; one line per entry only 970418 sxkac ua_date: add -format option, examples: sxkac@nugget> ua_date -f %Y/%m/%d\ %H:%M # special format 1997/04/18 16:44 sxkac@nugget> ua_date -f %m/%d/%y -1 # get yesterday's date 04/17/97 970417 sxkac uaiostat and uals: beefed up the README. added 'diff -e' so source can be reconstructed by those with license (thanks to knight@zk3.dec.com). 970407 sxkac ua_boot: allow for a single word reason; supporting scripts modified to reduce sudo use and to identify which node sudo password required for for network boots. ______________________________________________________________________________ 970329 sxkac v0.5a uaiostat is now DU v4.0 (or v3.x) compatable 970329 sxkac uaiostat: updated source to DU v4.0 release (trivial, will run in either v3.2 or v40). Required: disk_info mods as v4.0 shows device type as 'cam' vs. 'rz'; if root authority will read /dev/kmem to pick up device type. 970329 sxkac uashodev: s/uak_shrz/uashodev/ Renamed and updated for DU v4.0 (compiled with new disk_info). 970328 sxkac uakpacct: allow multiple commands or users to be specified, comma separated (they will be or'd); report char_i/o in k units, extend elapsed field, unsign mem; add 'management style' report; include cpu rate (pct) threshhold filter; added not-user and not-command ability (-user !root,oracle); added -time !hh:mm (start before) and -Time !hh:mm (end after). Examples: will get all processes > 120 cpu seconds and then use -at to find program associated with an oracle command. sxkac@glacier> uakpacct -m -r0 -f "`ls /var/adm/pacct*`" -cpu 120 #End_Date/Time Start_hh:mm:ss Userid Command CPU_Sec Elapsed Rate -------------- -------- ------ ------- ------- ------- ---- 03/29 10:16:04 10:00:03 sxfinp oracle 156.3 961.1 16.3 03/29 10:25:51 10:16:05 sxfinp oracle 191.9 585.6 32.8 03/29 10:44:59 08:14:27 snrar oracle 5738.5 9032.0 63.5 03/29 10:44:59 08:14:27 snrar fgrbavl 363.5 9032.0 4.0 03/29 12:15:12 10:51:09 sxfinp oracle 1377.0 5043.0 27.3 sxkac@glacier> uakpacct -m -r0 -f "`ls /var/adm/pacct*`" \ > -u sxfinp -T 10:25:51 -t 10:16:05 -at 2 #End_Date/Time Start_hh:mm:ss Userid Command CPU_Sec Elapsed Rate -------------- -------- ------ ------- ------- ------- ---- 03/29 10:25:51 10:16:05 sxfinp tgrfeed 10.7 586.4 1.8 03/29 10:25:51 10:16:05 sxfinp oracle 191.9 585.6 32.8 ______________________________________________________________________________ 970325 sxkac Submitted to www.digital.com/info/misc/register-pd-software v0.5 970322 sxkac uak_iosts (renamed as uaiostat): trap HUP to print summary; mask device name, e.g., rz*20 matches rz20, rza20, rzb20, etc; changed name s/uak_iosts/uaiostat/. add options: -t,-b,-i,-n,-s,-S,-p,-m,-e: -s show summary Include a summary of all intervals -S full summary Summary with rates, transfer counts, and block counts -t just transfers Don't show rates, just transfer count -b just kblocks Don't show rates, just k blocks -i only intervals Do not show rates or values since boot -n no tty stats Do not display tty statistics -pN page size Specify intervals per page (new headers), defaults now at 60, old hard-coded was 19. -mN max disks Specify maximum disks displayed, defaults now at 12 (132 columns), old default was 4, use 6 for 80 columns. -e exclude list drives specified are to be excluded. note for either include|exclude use '*' as a mask, e.g., rz*20 would match rz20, rza20, rzb20... 970322 sxkac uakpacct: change -aflag input to octal since it's displayed that way; add fclose which was missing when multiple files supported; 970322 sxkac ua_arg/uaccilib.h: add support for octal and hexadecimal arguments. 970321 sxkac ua_oraio: added to analyze oracle io rates (sql extract), requires io_rates.sql and file naming conventions. 970319 sxkac ua_date: add -seconds, e.g., sleep `ua_date .13:00 .14:00 -s`; also recognize "" or . as now. 970313 sxkac uakpacct: allow multiple files input; default start date to first record read end date. 970312 sxkac uakce: add -lower, -upper actions and -trail flag ______________________________________________________________________________ 970305 sxkac v0.4 970217 sxkac ua_date: add delta date to calculate elapsed time; add yyyymmdd, mmdd, dd syntaxes; add '/' date and ':' time optional delimiters; make 2000 safe. 970216 sxkac added mirrorset & stripset to hszterm.ksh 970216 sxkac corrected uak_iosts headers (disk name misaligned) 970214 sxkac added uawhich (a smart version of /usr/bin/which) 970214 sxkac changed uakce to default accept input from stdin ______________________________________________________________________________ 970122 sxkac added the 'uals' program (enhancements to ls), v0.3 reference ./src/ls/README. sxkac added the im053a.ps (and im053a.doc MS/Word6) files from DECUS presentation: "Digital Unix and Oracle7: Recipes for Disaster?" sorry, the powerpoint slides with the infamous lemon and mushroom could not be included. sxkac minor enhancments to uak_iosts (iostat for hsz's) made: date.time stamp on header line; '0' activity displayed as '.' not ' ' so field orientation (vs. column orientation) maintained for piping elsewhere. sxkac note, as of DU v4.0b patches.tar.Z has become patches.tar in preparation for setld patch kits. no updates are occuring for older versions (by appearances)... stay tuned to Digital. sxkac other changes made here and there, see the sdiff listing (rebuild.. ______________________________________________________________________________ 961007 sxkac change ua_patch.c to recognize /sys/BINARY similar to v0.2 /usr/sys/BINARY, 'tis now showing up in 4.0a. Note that the .mod files are now being used some. 961001 sxkac added -lsecurity for uakid for issue of getluid; note this is an enhanced security function and n/a for some. ______________________________________________________________________________ 960904 sxkac change ua_patch.c and atlanta_ftp.ksh as follows: v0.1 recognize include files in a directory hierarchy, required for osfv32g and osfv32c patches; only print individual PATCH readme if atlanta/$VERSION.print (e.g., atlanta/osfv32d-1.print) exists; include ua_patch.exe stderr in summary mail message; validated for osfv32d-1, osfv40, osfv32g, and osfv32c, for patches.tar.Z available as of 960903. Note: for osfv32c OSF350-261,-265,-248 cannot be fully extracted... since I don't care about v3.2c I'm not going to pursue this, but quick glance indicates either these were constructed incorrectly by Digital or they have an elaborate install (reference their README files for details). 960904 sxkac include ./init.d and ./oracle samples as well as some additional /usr/local/doc files (nsr and unix). ______________________________________________________________________________ 960903 sxkac implement procedure to identify any changed files when rebuilding the kit; include file 'changes.log' to document changes. 960903 sxkac updated doc/patches (/PATCH/general_information) regarding PATCH_OS_VERS (thanks to bom@BIOBASE.DK) 960903 sxkac include /usr/local/doc/disk_fw (disk firmware upgrades). ______________________________________________________________________________