Mailling List Archives

[Stephen Burke]

Thanks.
That did the trick nicely.
I'm sending the 4mb or so tar to your return address, but since you seem 
to have mailboxes all over the place at the moment, I thought I'd let 
you know here.

S.

John Seth wrote:
> I ended up creating a 'settings.mrc' file with lots of extra info in it. 
>  The top 5 lines are what you'd be most interested in, besides the 
> command line options.  A copy of the settings.mrc file can be found here:
> 
>    http://www.nflug.com/archives/settings.mrc.phps
> 
> Then from the same directory I have the 'settings.mrc' file, I run the 
> command from a shell script named 'nflugarch', which is executable and 
> contains the following:
> -- 
> #!/bin/sh
> 
> /usr/local/sbin/mhonarc --modifybodyaddresses -rcfile settings.mrc \
> -outdir /home/nflugweb/public_html/archives/2005_07 \
> /home/johnseth/mail/nflug-mbox
> 
> -- 
> 
> I haven't really taken a look into MHonArc to see if I can further 
> automate the process above.  If I let my file 'nflug-mbox' grow, it'd 
> store ALL email into the 2005_07 directory, which at present, is only 
> meant for archiving this months email.  Suffice it to say, when August 
> comes rolling around, if I don't have an automated method of doing it by 
> then, I'll have to manually rotate the mailbox.
> 
> Since I installed it into /usr/local/sbin, I have to be root to run it, 
> or be able to 'sudo'.  This is necessary since my email comes into one 
> account, and I have the archives being created in another.
> 
> Hope that helps :)
> 
> 
> 
> 
> Stephen Burke wrote:
> 
>> Did you use -addressmodifycode at the command line or rewrite 
>> /usr/bin/mhonarc, or what?
>>
>> The command line way keeps complaining with:
>>
>> This is MHonArc v2.6.12, Perl 5.008 linux
>> Array found where operator expected at (eval 6) line 4, at end of line
>>         (Missing operator before ?)
>>
>> ERROR: Unable to create rewrite_address routine:
>> syntax error at (eval 6) line 4, near "address at hidden"
>>
>> the command I used was:
>>
>> mhonarc /home/qfwfq/.mozilla/qfwfq/02sk2223.slt/Mail/Local\ 
>> Folders/nflug_in -addressmodifycode $_ = 'address at hidden';
>>
>> Clearly, I need to understand perl better, but for the sake of getting 
>> this stuff into the archive, can you give me a hint on how you went 
>> address munging?
>>
>> Thanks,
>> S.
>>
>> John Seth wrote:
>>
>>> I've been fiddling around with MHonArc's mailling list script, and 
>>> found it really easy to modify, and here I was expecting a daunting 
>>> task to remove all email addresses ;)
>>>
>>> Anyhow... the archives now have munged the addresses so that all 
>>> domains are "@HIDDEN.DOMAIN".  The only _slight_ downfall is, some 
>>> messages may not be easy to know who posted it.
>>>
>>> If no one has any issues with what's displayed, I think it's now 
>>> fairly safe to link to from the main webpage... thoughts?
>>>
>>>    http://www.nflug.com/archives/
>>>
>>> - Tony
>>>
>>>
>>>
>>> Cyber Source wrote:
>>>
>>>> ok cool
>>>>
>>>> John Seth wrote:
>>>>
>>>>> That is true, and is one reason why the archives are not linked to 
>>>>> from the main webpage, but must be accessed directly. The only way 
>>>>> a spider or other email harvesting bot could obtain the email 
>>>>> addresses is to have someone else link to the archives somewhere 
>>>>> other than NFLUG's list.
>>>>>
>>>>> Until I find a way to accomplish a good munge, or just remove the 
>>>>> email addresses from the archive process, I personally, will not 
>>>>> link to them anywhere on the web.
>>>>>
>>>>> - Tony
>>>>>
>>>>>
>>>>> ------------------------------------------------------------
>>>>> Date: Sun, 03 Jul 2005 07:37:29 -0400
>>>>> From: Cyber Source <peter at thecybersource.com>
>>>>> To: nflug at nflug.org
>>>>> Subject: Re: Mailling List Archives
>>>>>
>>>>> There is one small problem with that and correct me if I'm wrong but
>>>>> whenever I create web pages for people I purposely keep there email
>>>>> addresses out of the pages directly. Couldn't a bod spider through 
>>>>> those
>>>>> archives now and pickup all the email addresses therein? I know 
>>>>> that you
>>>>> have to be a member for the nflug site itself to forward emails but 
>>>>> the
>>>>> members email addresses themselves are in those archives. 
>>>>> Fortunately, I
>>>>> have spamassasin doing a very nice job on our email servers but for
>>>>> those without such protection, they may start to get pounded with 
>>>>> spam.
>>>>> Is there not a way to have your perl script mangle the members email
>>>>> addresses or strip them off altogether? I think what you've done 
>>>>> for the
>>>>> list is great but I also think this could lead to a spam problem. Any
>>>>> other thoughts?
>>>>>
>>>>> John Seth wrote:
>>>>>
>>>>> > Just an update for those that are interested. I recently came 
>>>>> across a
>>>>> > perl program that converts mailbox format inboxes to HTML and 
>>>>> creates
>>>>> > the HTML pages for date & thread sorted displays. I stopped myself
>>>>> > from deleting any email coming in from the list, and gathered up 
>>>>> what
>>>>> > I had previously and new, and threw them into an mbox formatted 
>>>>> file,
>>>>> > and converted them.
>>>>> >
>>>>> > What I have kept, is now archived on the NFLUG.com website, and I 
>>>>> now
>>>>> > have my mail server saving and converting any new email from the
>>>>> > mailing list. Currently, about once a week I will update the 
>>>>> archives
>>>>> > to ensure it is working as desired, then... I'll make it a twice 
>>>>> daily
>>>>> > thing most likely, and archive on a per month basis.
>>>>> >
>>>>> > If anyone has not deleted any email, and perhaps has all the NFLUG
>>>>> > email in a single file... feel free to email it to me :) or burn 
>>>>> it to
>>>>> > cd and snail-mail it (or hand deliver if ya feel like driving to
>>>>> > Fredonia). I'll be more than happy, and anxious, to get archives up
>>>>> > for the list.
>>>>> >
>>>>> > You can view the current archives at:
>>>>> >
>>>>> > http://www.nflug.com/archives/
>>>>> >
>>>>> >
>>>>> >
>>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>>
> 
>