Mailling List Archives

[John Seth]

I ended up creating a 'settings.mrc' file with lots of extra info in it. 
  The top 5 lines are what you'd be most interested in, besides the 
command line options.  A copy of the settings.mrc file can be found here:

    http://www.nflug.com/archives/settings.mrc.phps

Then from the same directory I have the 'settings.mrc' file, I run the 
command from a shell script named 'nflugarch', which is executable and 
contains the following:
--
#!/bin/sh

/usr/local/sbin/mhonarc --modifybodyaddresses -rcfile settings.mrc \
-outdir /home/nflugweb/public_html/archives/2005_07 \
/home/johnseth/mail/nflug-mbox

--

I haven't really taken a look into MHonArc to see if I can further 
automate the process above.  If I let my file 'nflug-mbox' grow, it'd 
store ALL email into the 2005_07 directory, which at present, is only 
meant for archiving this months email.  Suffice it to say, when August 
comes rolling around, if I don't have an automated method of doing it by 
then, I'll have to manually rotate the mailbox.

Since I installed it into /usr/local/sbin, I have to be root to run it, 
or be able to 'sudo'.  This is necessary since my email comes into one 
account, and I have the archives being created in another.

Hope that helps :)




Stephen Burke wrote:
> Did you use -addressmodifycode at the command line or rewrite 
> /usr/bin/mhonarc, or what?
> 
> The command line way keeps complaining with:
> 
> This is MHonArc v2.6.12, Perl 5.008 linux
> Array found where operator expected at (eval 6) line 4, at end of line
>         (Missing operator before ?)
> 
> ERROR: Unable to create rewrite_address routine:
> syntax error at (eval 6) line 4, near "address at hidden"
> 
> the command I used was:
> 
> mhonarc /home/qfwfq/.mozilla/qfwfq/02sk2223.slt/Mail/Local\ 
> Folders/nflug_in -addressmodifycode $_ = 'address at hidden';
> 
> Clearly, I need to understand perl better, but for the sake of getting 
> this stuff into the archive, can you give me a hint on how you went 
> address munging?
> 
> Thanks,
> S.
> 
> John Seth wrote:
> 
>> I've been fiddling around with MHonArc's mailling list script, and 
>> found it really easy to modify, and here I was expecting a daunting 
>> task to remove all email addresses ;)
>>
>> Anyhow... the archives now have munged the addresses so that all 
>> domains are "@HIDDEN.DOMAIN".  The only _slight_ downfall is, some 
>> messages may not be easy to know who posted it.
>>
>> If no one has any issues with what's displayed, I think it's now 
>> fairly safe to link to from the main webpage... thoughts?
>>
>>    http://www.nflug.com/archives/
>>
>> - Tony
>>
>>
>>
>> Cyber Source wrote:
>>
>>> ok cool
>>>
>>> John Seth wrote:
>>>
>>>> That is true, and is one reason why the archives are not linked to 
>>>> from the main webpage, but must be accessed directly. The only way a 
>>>> spider or other email harvesting bot could obtain the email 
>>>> addresses is to have someone else link to the archives somewhere 
>>>> other than NFLUG's list.
>>>>
>>>> Until I find a way to accomplish a good munge, or just remove the 
>>>> email addresses from the archive process, I personally, will not 
>>>> link to them anywhere on the web.
>>>>
>>>> - Tony
>>>>
>>>>
>>>> ------------------------------------------------------------
>>>> Date: Sun, 03 Jul 2005 07:37:29 -0400
>>>> From: Cyber Source <peter at thecybersource.com>
>>>> To: nflug at nflug.org
>>>> Subject: Re: Mailling List Archives
>>>>
>>>> There is one small problem with that and correct me if I'm wrong but
>>>> whenever I create web pages for people I purposely keep there email
>>>> addresses out of the pages directly. Couldn't a bod spider through 
>>>> those
>>>> archives now and pickup all the email addresses therein? I know that 
>>>> you
>>>> have to be a member for the nflug site itself to forward emails but the
>>>> members email addresses themselves are in those archives. 
>>>> Fortunately, I
>>>> have spamassasin doing a very nice job on our email servers but for
>>>> those without such protection, they may start to get pounded with spam.
>>>> Is there not a way to have your perl script mangle the members email
>>>> addresses or strip them off altogether? I think what you've done for 
>>>> the
>>>> list is great but I also think this could lead to a spam problem. Any
>>>> other thoughts?
>>>>
>>>> John Seth wrote:
>>>>
>>>> > Just an update for those that are interested. I recently came 
>>>> across a
>>>> > perl program that converts mailbox format inboxes to HTML and creates
>>>> > the HTML pages for date & thread sorted displays. I stopped myself
>>>> > from deleting any email coming in from the list, and gathered up what
>>>> > I had previously and new, and threw them into an mbox formatted file,
>>>> > and converted them.
>>>> >
>>>> > What I have kept, is now archived on the NFLUG.com website, and I now
>>>> > have my mail server saving and converting any new email from the
>>>> > mailing list. Currently, about once a week I will update the archives
>>>> > to ensure it is working as desired, then... I'll make it a twice 
>>>> daily
>>>> > thing most likely, and archive on a per month basis.
>>>> >
>>>> > If anyone has not deleted any email, and perhaps has all the NFLUG
>>>> > email in a single file... feel free to email it to me :) or burn 
>>>> it to
>>>> > cd and snail-mail it (or hand deliver if ya feel like driving to
>>>> > Fredonia). I'll be more than happy, and anxious, to get archives up
>>>> > for the list.
>>>> >
>>>> > You can view the current archives at:
>>>> >
>>>> > http://www.nflug.com/archives/
>>>> >
>>>> >
>>>> >
>>>>
>>>
>>>
>>>
>>
>>
> 
> 
>