I have been unable to find any reference to Ruby methods that provide
raw disk access the way dd does. I frequently use the Linux utility
program, dd, and would like to be able to do the same type of byte-level
and sector-level access to the hard drive with Ruby. (What I am looking
for is not file access.) Are there Ruby methods to provide this
capability (other than having Ruby access dd)?
Thanks,
Gary
From: “Gary H.” [email protected]
I have been unable to find any reference to Ruby methods that provide
raw disk access the way dd does. I frequently use the Linux utility
program, dd, and would like to be able to do the same type of byte-level
and sector-level access to the hard drive with Ruby. (What I am looking
for is not file access.) Are there Ruby methods to provide this
capability (other than having Ruby access dd)?
[i think my previous post didn’t make it to the list]
dd if=/dev/hdb bs=512 count=1 | hexdump -C
…should be equivalent to…
ruby -e ‘File.open(“/dev/hdb”, “rb”) {|io| print(io.read(512))}’ |
hexdump -C
Regards,
Bill
On Nov 26, 2009, at 4:07 PM, Gary H. wrote:
I have been unable to find any reference to Ruby methods that provide
raw disk access the way dd does. I frequently use the Linux utility
program, dd, and would like to be able to do the same type of byte-level
and sector-level access to the hard drive with Ruby. (What I am looking
for is not file access.) Are there Ruby methods to provide this
capability (other than having Ruby access dd)?
dd doesn’t ever have ‘raw disk access’ or ‘sector’ level access to a
disk drive so I’m not sure how to respond.
A raw disk device just presents the underlying drive as a file. You use
seek and read and write to accomplish I/O but it is generally a mistake
to think that you are accessing particular ‘sectors’ when you do this.
Modern disks drives have complex geometries that aren’t visible unless
you are working at the device driver level.
To utilize ‘raw’ I/O with Ruby look at IO#sysread, IO#syswrite, and
IO#sysseek. This would be analogous to a C program utilizing the
similarly named system calls. You’ll also want to open the device file
in binary mode and also be sure that you don’t use any of the buffered
I/O methods (i.e. don’t mix and match).
Gary W.
On 27 Nov 2009, at 03:46, Gary W. wrote:
A raw disk device just presents the underlying drive as a file. You use seek and read and write to accomplish I/O but it is generally a mistake to think that you are accessing particular ‘sectors’ when you do this. Modern disks drives have complex geometries that aren’t visible unless you are working at the device driver level.
To utilize ‘raw’ I/O with Ruby look at IO#sysread, IO#syswrite, and IO#sysseek. This would be analogous to a C program utilizing the similarly named system calls. You’ll also want to open the device file in binary mode and also be sure that you don’t use any of the buffered I/O methods (i.e. don’t mix and match).
For a gentle intro to the more general topic of using Ruby for systems
programming on a Unix box, take a look at the Ruby Plumber’s Guide
presentations linked from my signature. Also buy yourself a copy of Marc
Rochkind’s “Advanced Unix Programming” which is as light a read as is
possible given the nature of the subject matter 
Ellie
raise ArgumentError unless @reality.responds_to? :reason
The more fun solution would of course be to code the hex dumping in
Ruby also.
Hex Dumping in Ruby! I can hear a code puzzle coming up already!
2009/11/27 Bill K. [email protected]:
[i think my previous post didn’t make it to the list]
dd if=/dev/hdb bs=512 count=1 | hexdump -C
…should be equivalent to…
ruby -e ‘File.open(“/dev/hdb”, “rb”) {|io| print(io.read(512))}’ | hexdump
-C
Just a small remark: when using #read for reading I would prefer to
also use #write for writing. It is more symmetric and It may actually
be that #print does a bit more in light of i18n support in Ruby 1.9.
So that would be
ruby -e ‘File.open(“/dev/hdb”, “rb”) {|io|
$stdout.write(io.read(512))}’ | hexdump -C
The more fun solution would of course be to code the hex dumping in
Ruby also. 
Kind regards
robert
On 11/28/2009 01:26 AM, Bill K. wrote:
The more fun solution would of course be to code the hex dumping in
Ruby also.
Here’s a stab at it… (it does work properly if the last
read returns fewer than 16 bytes.)
What makes it stop working properly if the file size is a multiple of
16?
ruby -e ‘File.open("/dev/hdb", “rb”) {|io| print(io.read(512))}’ |
ruby -e ‘i=0; while(x=ARGF.read(16)); puts("%08x %-32s %s" % [i, x.unpack(“H*”), x.tr("^\040-\176",".")]); i+=16; end’
Why do you separate this in two processes? I’ve munged it a bit…
ruby -e ‘File.open("/dev/hdb", “rb”){|io|i=0;while(l=io.read(16));
printf("%06x %-32s %s\n",i,l.unpack(“H*”).first,l.tr("^\040-\176","."));
i+=l.bytesize end}’
Cheers
robert
From: “Robert K.” [email protected]
On 11/28/2009 01:26 AM, Bill K. wrote:
read returns fewer than 16 bytes.)What makes it stop working properly if the file size is a multiple of 16?
It works OK in either case, is what I was trying to say.
ruby -e ‘File.open(“/dev/hdb”, “rb”) {|io| print(io.read(512))}’ |
ruby -e ‘i=0; while(x=ARGF.read(16)); puts(“%08x %-32s %s” % [i, x.unpack(“H*”), x.tr(“^\040-\176”,“.”)]); i+=16; end’Why do you separate this in two processes? I’ve munged it a bit…
Same reason dd and hexdump are separate programs.
http://www.faqs.org/docs/artu/ch01s06.html
ruby -e ‘File.open(“/dev/hdb”, “rb”){|io|i=0;while(l=io.read(16));
printf(“%06x %-32s %s\n”,i,l.unpack(“H*”).first,l.tr(“^\040-\176”,“.”));
i+=l.bytesize end}’Cheers
robert
Regards,
Bill
From: “Robert K.” [email protected]
ruby -e ‘File.open(“/dev/hdb”, “rb”) {|io|
$stdout.write(io.read(512))}’ | hexdump -C
Hmm. From my point of view, symmetry-for-symmetry’s sake can’t
generally apply here, because, for example, I would expect the
following to be bad form:
$stdout.syswrite(io.sysread(512))}’ | hexdump -C
I.e., since ‘io’ and stdout are separate streams, I may choose
to call only ‘sys’ methods on ‘io’, but I can’t in turn
reasonably expect to call corresponding ‘sys’ methods on the
(presumably buffered) $stdout …
However, your observation did make me curious as to how different
‘print’ might be from ‘write’ vis-a-vis m17n on ruby 1.9.x.
In the 1.9.2dev sources, it appears ‘write’ and ‘print’ are
nearly identical (rb_io_print calls rb_io_write), but, that
each argument to print will be followed by the “output record
separator” string, if it is non-nil. ( $\ )
So if we wish to avoid the possibility of $\ contaminating our
output, we indeed should call write instead of print.
The more fun solution would of course be to code the hex dumping in
Ruby also.
Here’s a stab at it… (it does work properly if the last
read returns fewer than 16 bytes.)
ruby -e ‘File.open(“/dev/hdb”, “rb”) {|io| print(io.read(512))}’ |
ruby -e ‘i=0; while(x=ARGF.read(16)); puts(“%08x %-32s %s” % [i,
x.unpack(“H*”), x.tr(“^\040-\176”,“.”)]); i+=16; end’
Regards,
Bill
Thank you all for your guidance. I am now able to do with Ruby what I
previously need dd for.
However, I am not able to cleanly test for the end of file due to the
following error:
until file_1.eof?
file_1_byte = file_1.sysread( 1 )
end
ERROR MSG:
./Ruby_file_test.rb:23:in `sysread’: sysread for buffered IO (IOError)
from ./Ruby_file_test.rb:23
All of my file accesses are sysread, syswrite, and sysseek, which are
not compatible with IO#eof.
Using the file size to prevent hitting the EOF does not work for
/dev/sdb.
So, I just let it generate an EOF error and then rescue it.
It seems like there ought to be a working EOF function for IO#sys…
Gary
On Nov 26, 2:07 pm, Gary H. [email protected] wrote:
I have been unable to find any reference to Ruby methods that provide
raw disk access the way dd does. I frequently use the Linux utility
program, dd, and would like to be able to do the same type of byte-level
and sector-level access to the hard drive with Ruby. (What I am looking
for is not file access.) Are there Ruby methods to provide this
capability (other than having Ruby access dd)?
gem install sys-filesystem
Regards,
Dan
On 29.11.2009 01:25, Gary H. wrote:
ERROR MSG:
It seems like there ought to be a working EOF function for IO#sys…
Question is why do you use #sysread in the first place? As far as I can
see there is no advantage of using #sysread here.
Also, reading a single byte at a time might be easier for the
implementation but it is almost inevitably dramatically slower than
reading in chunks. If you use #sysread you should definitively read
in chunks because #sysread does not buffer IIRC.
Kind regards
robert
On 28.11.2009 19:12, Bill K. wrote:
From: “Robert K.” [email protected]
On 11/28/2009 01:26 AM, Bill K. wrote:
read returns fewer than 16 bytes.)
What makes it stop working properly if the file size is a multiple of 16?It works OK in either case, is what I was trying to say.
Ah, OK. Thanks for the clarification!
ruby -e ‘File.open(“/dev/hdb”, “rb”) {|io| print(io.read(512))}’ |
ruby -e ‘i=0; while(x=ARGF.read(16)); puts(“%08x %-32s %s” % [i, x.unpack(“H*”), x.tr(“^\040-\176”,“.”)]); i+=16; end’
Why do you separate this in two processes? I’ve munged it a bit…Same reason dd and hexdump are separate programs.
Well, but in light of that neither a Ruby replacement of dd or hexdump
is needed as they do exist already and do their job properly - and
likely even more efficient than Ruby.
Kind regards
robert
On Nov 29, 2009, at 8:00 AM, Robert K. wrote:
formatting of the output. Source code must be shorter than 20 lines
of code per additional option.
Kind regards
robert
–
remember.guy do |as, often| as.you_can - without end
http://blog.rubybestpractices.com/
That sounds like quiz #171 - hexdump - from early this year.
http://rubyquiz.strd6.com/quizzes/171
-Rob
My reasons for wanting to use Ruby in place of dd is that I wanted to be
able to do whatever I wanted to the hard drive from a wxRuby GUI. I have
several Bash scripts that do things that I would prefer to use a GUI
for. Plus, I wanted to see just how well Ruby could do low-level tasks.
I used sysread and syswrite because, as the manual states: “syswrite is
a low-level, unbuffered, nontranscoding version of write”. If I am going
to modify the partition table on the hard drive, I want to be sure that
reads and writes are doing what I tell them to do.
As for writing only one byte in my example, it was simply a test
example. If I could correctly write one byte to the unpartitioned area
of my hard drive, then I knew that Ruby could do what I wanted.
Gary
2009/11/29 Rob B. [email protected]:
read operation. You may also invent any number of additional options which
control formatting of the output. Source code must be shorter than 20 lines
of code per additional option.
That sounds like quiz #171 - hexdump - from early this year.
I swear I wasn’t aware of that. But the idea isn’t too esoteric so it
comes as no surprise that several people have had it. There is at
least a small difference in that I included the “dd” part which does
not seem to be present in #171.
Kind regards
robert
This forum is not affiliated to the Ruby language, Ruby on Rails framework, nor any Ruby applications discussed here.
Sponsor our Newsletter | Privacy Policy | Terms of Service | Remote Ruby Jobs