OpenEuphoria

Re: Sequences and long files

• Posted by Irv <irv at ELLIJAY.COM> May 08, 1998
• 652 views

At 11:52 PM 5/7/98 -0400, you wrote:

>>There's also the problem of Euphoria's native sequence
>>format: a 300 meg data file would probably take 2 or 3
>>times that much disk space.
>>If s = {"Now is the time",123}, -- 20 bytes more or less --
>>it takes 63 bytes to store on disk with a print(fn,s)
>
>     A few more instructions keeps the format readable by get() but saves a
>good deal of disk space.  Use printf to print the strings as strings and
>actually print out the quotes, braces, and commas.
>
>puts( fn, "{" )
>for whatever = 1 to NumberOfRecords do
>   puts( fn, "{" )
>   for count = 1 to length( record ) do
>      data = record[count]
>      if sequence( data ) then
>               printf( fn, "\"%s\"", data )
>      else
>               printf( fn, "%d", data )
>      end if
>      if count != length( record ) then
>         puts( fn, "," )
>      end if
>   end for
>   puts( fn, "}" )
>if whatever != NumberOfRecords then
>   puts( fn, "," )
>end if
>end for
>puts( fn, "}" )
>
>     That's just my spur of the moment typing...it could probably be made
>smaller and/or made into a general purpose recursive function.  Of course,
>if you don't know that all your data is either strings or numbers then you'd
>also have to check for sequences inside of sequences and recurse down
>properly.

If you use the %d to print numbers, you'll lose the decimals.
You can use %f to save the number accurately (more or less),
but that takes a lot of space. If there are more numbers than
strings in your data, it will take MORE space than the native format. Arrgh!

Irv