1. EBCDIC Formatted File (Help Needed)
- Posted by cklester <cklester at yahoo.com> Oct 13, 2004
- 483 views
I've got a file from a government agency that is in EBCDIC format (shoot me now). It is almost 140MB in size. I'm trying to use Hayden McKay's EBCDIC converter, and I'm sure it will work, but I can't even get the raw file loaded up! I tried using "rb" and gets() but that was taking a million years to load the file and I couldn't interrupt it nicely. Then I tried using "rb" and getc(), but that will obviously take a million years also, but at least I could put a tracking counter on screen and use SPACE to stop it. Am I just going to have to be patient loading this big boy into a variable so I can txt = ebcdic_to_ascii( txt ) it? AAARRRRRRRGGGHH!!! Here's my program, in case anybody wants to revise/advise/contemplize. ---start -- EBCDIC file converter include ebcdic.e include get.e include graphics.e include wildcard.e object fn, line, junk sequence txt, fname txt = "" fname = "orf850" puts(1,"Opening " & fname & "...") fn = open(fname,"rb") clear_screen() line = getc(fn) while line != -1 do txt &= line position(1,1) ?length(txt) line = getc(fn) junk = get_key() if junk = ' ' then line = -1 end if end while close(fn) puts(1,"Convert? (Y/N) ") junk = wait_key() if upper(junk) = 'Y' then txt = ebcdic_to_ascii( txt ) fn = open("orf850a","wb") puts(fn,txt) close(fn) end if puts(1,"\nFinished.") junk = wait_key() ---end -=ck "Programming in a state of EUPHORIA." http://www.cklester.com/euphoria/
2. Re: EBCDIC Formatted File (Help Needed)
- Posted by Tommy Carlier <tommy.carlier at telenet.be> Oct 13, 2004
- 492 views
cklester wrote: > I've got a file from a government agency that is in EBCDIC format (shoot > me now). It is almost 140MB in size. I'm trying to use Hayden McKay's > EBCDIC converter, and I'm sure it will work, but I can't even get the > raw file loaded up! I tried using "rb" and gets() but that was taking > a million years to load the file and I couldn't interrupt it nicely. Then > I tried using "rb" and getc(), but that will obviously take a million years > also, but at least I could put a tracking counter on screen and use SPACE > to stop it. Am I just going to have to be patient loading this big boy into > a variable so I can txt = ebcdic_to_ascii( txt ) it? AAARRRRRRRGGGHH!!! > > Here's my program, in case anybody wants to revise/advise/contemplize. > > ---start > -- EBCDIC file converter > > include ebcdic.e > include get.e > include graphics.e > include wildcard.e > > object fn, line, junk > sequence txt, fname > > txt = "" > fname = "orf850" > > puts(1,"Opening " & fname & "...") > fn = open(fname,"rb") > clear_screen() > > line = getc(fn) > while line != -1 do > txt &= line > position(1,1) > ?length(txt) > line = getc(fn) > junk = get_key() > if junk = ' ' then > line = -1 > end if > end while > close(fn) > > puts(1,"Convert? (Y/N) ") > junk = wait_key() > if upper(junk) = 'Y' then > txt = ebcdic_to_ascii( txt ) > fn = open("orf850a","wb") > puts(fn,txt) > close(fn) > end if > > puts(1,"\nFinished.") > junk = wait_key() > ---end I think it's better if you convert it in chunks: read a chunk of bytes, convert it, write it to file, rinse and repeat. Something like this (untested code):
include ebcdic.e include get.e include wildcard.e integer fn_in, fn_out sequence fname_in, fname_out, chunk fname_in = "orf850" fname_out = "orf850a" fn_in = open(fname_in, "rb") fn_out = open(fname_out, "wb") chunk = get_bytes(fn_out, 1000) while length(chunk) do puts(fn_out, ebcdic_to_ascii(chunk)) chunk = get_bytes(fn_in, 1000) end while close(fn_in) close(fn_out)
-- tommy online: http://users.telenet.be/tommycarlier tommy.blog: http://tommycarlier.blogspot.com Euphoria Message Board: http://uboard.proboards32.com Empire for Euphoria: http://empire.iwireweb.com
3. Re: EBCDIC Formatted File (Help Needed)
- Posted by Jonas Temple <jtemple at yhti.net> Oct 13, 2004
- 463 views
cklester wrote: > > I've got a file from a government agency that is in EBCDIC format (shoot > me now). HEY!!! What's wrong with EBCDIC? ;) IF they were thinking ahead, most IBM (and I'm assuming it's IBM) machines with a current OS release support translation from EBCDIC to ASCII. Maybe you could ask them for this? Wait...big government agency...might take a few months! I work on an EBCDIC machine so if I can offer any assistance I will. I haven't used the EBCDIC to ASCII routines that you referenced but hopefully it will translate correctly meaning EBCDIC has CCSID/codepages just like ASCII. Jonas Temple http://www.yhti.net/~jktemple
4. Re: EBCDIC Formatted File (Help Needed)
- Posted by cklester <cklester at yahoo.com> Oct 13, 2004
- 478 views
Jonas Temple wrote: > cklester wrote: > > I've got a file from a government agency that is in EBCDIC format (shoot > > me now). > HEY!!! What's wrong with EBCDIC? ;) http://www.dynamoo.com/technical/ascii-ebcdic.htm I actually had no experience with it up until today. :) -=ck "Programming in a state of EUPHORIA." http://www.cklester.com/euphoria/
5. Re: EBCDIC Formatted File (Help Needed)
- Posted by cklester <cklester at yahoo.com> Oct 13, 2004
- 477 views
Tommy Carlier wrote: > > cklester wrote: > > I've got a file from a government agency that is in EBCDIC format (shoot > > me now). It is almost 140MB in size. I'm trying to use Hayden McKay's > > EBCDIC converter, and I'm sure it will work, but I can't even get the > > raw file loaded up! > I think it's better if you convert it in chunks: > read a chunk of bytes, convert it, write it to file, > rinse and repeat. Yeah, you're right. :) Final proggie:
include ebcdic.e include get.e include wildcard.e include graphics.e integer fn_in, fn_out sequence fname_in, fname_out, chunk fname_in = "orf850" fname_out = "orf850a" clear_screen() fn_in = open(fname_in, "rb") fn_out = open(fname_out, "wb") chunk = get_bytes(fn_in, 1000) while length(chunk) do position(1,1) printf(1,"%d",{numchunks}) puts(fn_out, ebcdic_to_ascii(chunk)) chunk = get_bytes(fn_in, 1000) end while close(fn_in) close(fn_out)
Worked great! Hayden, regarding your ebcdic_to_ascii() function, I had to change it to the following to account for zeroes... Is this proper/correct?
-- Encodes an EBCDIC formatted string to ASCII. global function ebcdic_to_ascii(sequence string) sequence ascii ascii = {} for i = 1 to length(string) do if string[i] = 0 then -- because EBCDIC[0] is bad ascii &= 0 else if string[i] < 64 then ascii &= find(EBCDIC[string[i]], ASCII) else ascii &= EBCDIC[string[i]] end if end if end for return ascii end function
-=ck "Programming in a state of EUPHORIA." http://www.cklester.com/euphoria/
6. Re: EBCDIC Formatted File (Help Needed)
- Posted by Jonas Temple <jtemple at yhti.net> Oct 13, 2004
- 485 views
cklester wrote: > > > <a > href="http://www.dynamoo.com/technical/ascii-ebcdic.htm">http://www.dynamoo.com/technical/ascii-ebcdic.htm</a> > > I actually had no experience with it up until today. :) > Well, let's check the facts: 1. EBCDIC was around long before ASCII. Doesn't necessarily make it better. That's like saying electric cars are better than gasoline just because they're newer. EBCDIC and gasoline cars are what was needed at the time they were created because nothing else was out there. They both continue to run fine today. 2. The article cited some comparisons of programming in EBCDIC versus ASCII. The fact is that NO ONE programs like that on an IBM machine. We don't care what the control characters are because that is all handled by the OS! 3. The article specifically mentioned the AS/400. Yep, that's what I work on! It cast the 400 in a "antique" light. Hmmm, let's check a 400 against a PC: - Built-in database: Yes PC: No - Built-in IP services (HTTP, FTP, telnet, etc.): Yes PC: No - 99.9% uptime: Yes PC: No - Can get viruses: No PC: Yes - Can support multiple OS on single processor: Yes PC: No specifically: OS/400, AIX, Linux, Windows, SSP - Partitionable: Yes PC: No not talking about the "I have a Linux partition on my PC" stuff...I'm talking about running MULTIPLE OS at the same time. - Can partition on a SINGLE processor machine: Yes PC: No - Can manage/store PC/Unix style files: Yes PC: No - Same OS CDs can be installed on the smallest or largest machine: Yes PC: <bust out laughing> - Can write programs in: C/C++/Java/Cobol/RPG/RPGII/RPGIII/RPGIV/REXX Need I go on? The fact is it's near impossible to run a large business on PCs only. How do I know? Ask MS...in the past they tried to put their money where there mouth was and run their software distribution on PCs attached to a network. They gave a large software company a contract to rewrite their systems for their own OS. The end result? They threw it all out and ordered new AS/400s!!!!! I have an AS/400 in my basement. It's an older model but since I got the OS installed and configured I haven't touched it. Yet I continue to spend hours on my PC trying to clean off viruses, spyware, adware and re-install the OS when all-of-a-sudden it starts shutting itself off at random intervals! I've been working on the 400 for 14 years and I have NEVER re-installed the OS because something was just acting "flaky". Try to tell the president of a company that you have to re-install the OS and he won't be able to take orders for a couple of days. Yeah, right! Sorry for the rant but I've had it people dissin' the best machine out there! Jonas Temple http://www.yhti.net/~jktemple
7. Re: EBCDIC Formatted File (Help Needed)
- Posted by cklester <cklester at yahoo.com> Oct 13, 2004
- 471 views
Jonas Temple wrote: > cklester wrote: > > <a > > href="http://www.dynamoo.com/technical/ascii-ebcdic.htm">http://www.dynamoo.com/technical/ascii-ebcdic.htm</a> > > I actually had no experience with it up until today. :) > Sorry for the rant but I've had it people dissin' the best machine out > there! I was dissing the EBCDIC file format... not the AS/400. :P (Does sound like a very cool machine, though!) :) -=ck "Programming in a state of EUPHORIA." http://www.cklester.com/euphoria/
8. Re: EBCDIC Formatted File (Help Needed)
- Posted by Jonas Temple <jtemple at yhti.net> Oct 13, 2004
- 481 views
cklester wrote: > I was dissing the EBCDIC file format... not the AS/400. :P > > (Does sound like a very cool machine, though!) :) > CK, I know you weren't dissin', sorry if you took it that way. I was just using the opportunity to "vent". And yes, it is a very cool machine. You can learn more at: http://www-1.ibm.com/servers/eserver/iseries/ Yeah, it's called an i5 now. Before that it was iSeries, before that it was AS/400, before that it was System/38, etc., etc. The new i5 comes in 1-way to 32-way processors. Oh, BTW, did I mention that the AS/400 was 64 bit? Has been since about 2002! AAMOF, the conversion from 32 to 64 bit for the 400 world was no more than restoring the 32 bit backup to the 64 bit machine. The OS recompiled all the code during the restore. 99.9999% of all software ran without modification (even stuff that was written 20 years before!). Put that in your pipe and smoke it, MS! For the curious I would even be willing to allow access to my 400. Jonas Temple http://www.yhti.net/~jktemple
9. Re: EBCDIC Formatted File (Help Needed)
- Posted by Bernard Ryan <xotron at bluefrog.com> Oct 13, 2004
- 504 views
Jonas Temple wrote: > better. That's like saying electric cars are better than gasoline just > because they're newer. EBCDIC and gasoline cars are what was needed at Jonas: Electric Cars have been around since 1830's Go here for more details. http://inventors.about.com/library/weekly/aacarselectrica.htm Bernie My files in archive: http://www.rapideuphoria.com/w32engin.zip http://www.rapideuphoria.com/mixedlib.zip http://www.rapideuphoria.com/eu_engin.zip http://www.rapideuphoria.com/win32eru.zip
10. Re: EBCDIC Formatted File (Help Needed)
- Posted by Jonas Temple <jtemple at yhti.net> Oct 13, 2004
- 473 views
- Last edited Oct 14, 2004
Jonas Temple wrote: > Oh, BTW, did I mention that the AS/400 was 64 bit? Has been since about > 2002! AAMOF, the conversion from 32 to 64 bit for the 400 world was no > more than restoring the 32 bit backup to the 64 bit machine. The OS > recompiled all the code during the restore. 99.9999% of all software ran > without modification (even stuff that was written 20 years before!). > Put that in your pipe and smoke it, MS! > Oops...I meant it's been 64 bit since 1992! Jonas Temple http://www.yhti.net/~jktemple