From: Martin Vorlaender [martin.vorlaender@pdv-systeme.de] Sent: Friday, October 05, 2001 2:31 AM To: Info-VAX@Mvb.Saic.Com Subject: Re: Announcing ht://Dig 3.1.5 for OpenVMS I happily announce release 3 of the ht://Dig VMS port. Besides a bug fix to make HTDIG's -t option now *really* work, this is a performance release. I was able to cut *in half* the time that HTDIG.EXE (the indexer) takes! [1] Hi, Jean-François :-) I split the distribution into binaries and data files. They are available at ftp://ftp.pdv-systeme.de/vms/htdig-3_1_5-vms-rel3.zip (2286 blocks) and ftp://ftp.pdv-systeme.de/vms/htdig-3_1_5-vms-data.zip (929 blocks) The data files haven't changed with respect to the first and second release, so anyone wo already has one of these will only need the binaries. A GNU diff file containing the changes to the first distribution is at ftp://ftp.pdv-systeme.de/vms/htdig-3_1_5-vms-rel3_source.diff Enjoy, Martin [1] The whole story: With the help of PCA - again, thanks a lot for the hobbyist program - I found that HTDIG.EXE spent nearly half its time in a particular fopen(). Looking at the source I found that this class' (WordList) methods open, write and close the output file every time an entry is added! Trusting in ODS-2, I changed the code to open the file once and keep it open, and voilà! Besides that, Paul Repacholi sent me the fopen() FAB and RAB options he used to speed up GZIP (thanks, Paul), but these didn't have a significant impact in my tests. On the contrary: the Berkeley DB file operations actually became slower... Think I'll have to toy around with those a bit. -- One OS to rule them all | Martin Vorlaender | VMS & WNT programmer One OS to find them | work: mv@pdv-systeme.de One OS to bring them all | http://www.pdv-systeme.de/users/martinv/ And in the Darkness bind them.| home: martin@radiogaga.harz.de