Comments for All Night Diner http://micropipes.com/blog because at 3am anything sounds good Tue, 31 Jan 2012 16:27:56 +0000 hourly 1 http://wordpress.org/?v=3.1.4 Comment on md5verify: A script to automatically verify file integrity by Leo http://micropipes.com/blog/2011/01/30/md5verify-a-script-to-automatically-verify-file-integrity/comment-page-1/#comment-96805 Leo Tue, 31 Jan 2012 16:27:56 +0000 http://micropipes.com/blog/?p=178#comment-96805 I found out your script while searching for a better solutions for verifying file integrity. My problem is a little bit different but it lays on the same land that yours, to be sure that the files still the same. I my case I do several HUGE copies and in some cases the files get corrupted during the process, what gives me an incredible headache. My solution did not work well since it took several hours to verify each file using cksum (On Solaris and HP-UX). As I supposed there's no way to perform a check sum of each file without wait hundreds of hours for the script to be finished. I know that it is a very tough task for the machine to open and hash the files but I was eager to find out some magic solution for it, and it seems there's not. Your script also take too much time to finish the verification. (Ok, I habe to check the integrity of 1000000 files) :\ Anyway, thanks for sharing your solution, it's pretty well done. :) I found out your script while searching for a better solutions for verifying file integrity. My problem is a little bit different but it lays on the same land that yours, to be sure that the files still the same.
I my case I do several HUGE copies and in some cases the files get corrupted during the process, what gives me an incredible headache. My solution did not work well since it took several hours to verify each file using cksum (On Solaris and HP-UX).
As I supposed there’s no way to perform a check sum of each file without wait hundreds of hours for the script to be finished.
I know that it is a very tough task for the machine to open and hash the files but I was eager to find out some magic solution for it, and it seems there’s not. Your script also take too much time to finish the verification. (Ok, I habe to check the integrity of 1000000 files) :\
Anyway, thanks for sharing your solution, it’s pretty well done. :)

]]> Comment on md5verify: A script to automatically verify file integrity by Wil Clouser http://micropipes.com/blog/2011/01/30/md5verify-a-script-to-automatically-verify-file-integrity/comment-page-1/#comment-95873 Wil Clouser Mon, 16 Jan 2012 19:06:10 +0000 http://micropipes.com/blog/?p=178#comment-95873 SQLite is an option. I wanted the capability of copying a directory and getting all the checksums under it automatically. SQLite is an option. I wanted the capability of copying a directory and getting all the checksums under it automatically.

]]> Comment on md5verify: A script to automatically verify file integrity by Adam http://micropipes.com/blog/2011/01/30/md5verify-a-script-to-automatically-verify-file-integrity/comment-page-1/#comment-95825 Adam Mon, 16 Jan 2012 08:30:23 +0000 http://micropipes.com/blog/?p=178#comment-95825 Thanks, Wil. I added the license to mine. I'm not sure if my hard drive is recently losing sectors or if upgrading my OS recently just caused sectors to be accessed and written which hadn't been in a long time--perhaps they were going bad for a long time. Anyway, smartmontools + this script will help me keep an eye on it. :) BTW, I wonder if using a SQLite db would be better than dumping hashfiles all over the place. What do you think? Thanks, Wil. I added the license to mine.

I’m not sure if my hard drive is recently losing sectors or if upgrading my OS recently just caused sectors to be accessed and written which hadn’t been in a long time–perhaps they were going bad for a long time. Anyway, smartmontools + this script will help me keep an eye on it. :)

BTW, I wonder if using a SQLite db would be better than dumping hashfiles all over the place. What do you think?

]]> Comment on md5verify: A script to automatically verify file integrity by Wil Clouser http://micropipes.com/blog/2011/01/30/md5verify-a-script-to-automatically-verify-file-integrity/comment-page-1/#comment-95810 Wil Clouser Mon, 16 Jan 2012 00:49:48 +0000 http://micropipes.com/blog/?p=178#comment-95810 Thanks Adam, I'll check out your changes. I'd be wary of running the script on a dying hard drive, it's pretty intensive. Sometimes I'm wary of running it on my healthy hard drives. :) I'll put a BSD license file in the root which is GPL compatible. Thanks Adam, I’ll check out your changes. I’d be wary of running the script on a dying hard drive, it’s pretty intensive. Sometimes I’m wary of running it on my healthy hard drives. :)

I’ll put a BSD license file in the root which is GPL compatible.

]]> Comment on md5verify: A script to automatically verify file integrity by Adam http://micropipes.com/blog/2011/01/30/md5verify-a-script-to-automatically-verify-file-integrity/comment-page-1/#comment-95764 Adam Sun, 15 Jan 2012 09:35:55 +0000 http://micropipes.com/blog/?p=178#comment-95764 Hey, this script was a lifesaver. I'm concerned that my hard disk may be in the early stages of failure, and I want to monitor files to see if their readable data changes. It took a lot of googling to find your script--it might help to mention some more key search terms, like "file integrity checker", "file alteration monitor" (not FAM, haha), "file checksum", "file modification detection", etc. Maybe those will help someone else. Anyway, I needed to make some changes to suit my needs, so I did: https://code.launchpad.net/~alphapapa/+junk/chafifi I also upgraded it to argparse. I already had a bzr repo for it when I decided to fork it on github...and I don't really want to use both for the same thing. So feel free to pull it out of there if you are interested in my version. BTW, can we officially GPL it? Thanks again. Hey, this script was a lifesaver. I’m concerned that my hard disk may be in the early stages of failure, and I want to monitor files to see if their readable data changes. It took a lot of googling to find your script–it might help to mention some more key search terms, like “file integrity checker”, “file alteration monitor” (not FAM, haha), “file checksum”, “file modification detection”, etc. Maybe those will help someone else.

Anyway, I needed to make some changes to suit my needs, so I did:

https://code.launchpad.net/~alphapapa/+junk/chafifi

I also upgraded it to argparse.

I already had a bzr repo for it when I decided to fork it on github…and I don’t really want to use both for the same thing. So feel free to pull it out of there if you are interested in my version.

BTW, can we officially GPL it?

Thanks again.

]]> Comment on Top 50 searches on addons.mozilla.org by T http://micropipes.com/blog/2009/05/26/top-50-searches-on-addonsmozillaorg/comment-page-1/#comment-87687 T Sun, 09 Oct 2011 09:25:18 +0000 http://micropipes.com/blog/?p=80#comment-87687 Fantastic I look forward to it. Thanks for the great info! Cheers T Fantastic I look forward to it.
Thanks for the great info!
Cheers
T

]]> Comment on Top 50 searches on addons.mozilla.org by Wil Clouser http://micropipes.com/blog/2009/05/26/top-50-searches-on-addonsmozillaorg/comment-page-1/#comment-87373 Wil Clouser Mon, 03 Oct 2011 15:58:31 +0000 http://micropipes.com/blog/?p=80#comment-87373 Thanks, there isn't a public interface for the data right now. It was just something I cooked up on a plane ride. I'll try to come up with some more interesting stats soon. Thanks, there isn’t a public interface for the data right now. It was just something I cooked up on a plane ride. I’ll try to come up with some more interesting stats soon.

]]> Comment on Top 50 searches on addons.mozilla.org by T http://micropipes.com/blog/2009/05/26/top-50-searches-on-addonsmozillaorg/comment-page-1/#comment-87369 T Mon, 03 Oct 2011 13:21:09 +0000 http://micropipes.com/blog/?p=80#comment-87369 Very interesting stats thanks! Is there any place to find such updated data? Are those sats or raw data public? Could you point me to where i can find them? Thanks T Very interesting stats thanks!
Is there any place to find such updated data?
Are those sats or raw data public? Could you point me to where i can find them?
Thanks
T

]]> Comment on Security in Depth; the first layer of addons.mozilla.org by Fred http://micropipes.com/blog/2011/05/20/security-in-depth-the-first-layer-of-addons-mozilla-org/comment-page-1/#comment-76881 Fred Fri, 20 May 2011 17:03:10 +0000 http://micropipes.com/blog/?p=243#comment-76881 Good writeup, Wil! AMO is blazing a trail for web security here at Mozilla (and throughout the web) and I am always happy to see security measures like these bubble up into a standard practice across all our web properties. Good writeup, Wil! AMO is blazing a trail for web security here at Mozilla (and throughout the web) and I am always happy to see security measures like these bubble up into a standard practice across all our web properties.

]]> Comment on Welcome to the Landfill by Witia http://micropipes.com/blog/2011/03/29/welcome-to-the-landfill/comment-page-1/#comment-75474 Witia Wed, 27 Apr 2011 09:44:00 +0000 http://micropipes.com/blog/?p=196#comment-75474 Now registration works. Thanks :) Now registration works. Thanks :)

]]>