Pages: [1]
  Print  
Author Topic: Processing huge flat files  (Read 1936 times)
arund
Newbie
*

Karma: +0/-0
Posts: 1


View Profile Email
« on: March 21, 2011, 10:08:26 PM »

I want to process huge flat file having 50k to 100k records, with fix positional mapping.
There two identical files with minor different and have logical relation. 

Do you know if there is any third party app or library which can support loading of such flat files into system?
Logged
MOON JAVA
« on: March 21, 2011, 10:08:26 PM »

 Logged
garyg
Newbie
*

Karma: +0/-0
Posts: 12


View Profile
« Reply #1 on: March 22, 2011, 06:01:37 PM »

There is a good java library JavaCC which can help you in parsing flat files.

javaCC uses regular expressions.

However, if it is a fixed position file,  where you know the start and end location of strings to capture, then I will recommend to use simple IO to read flat file and string buffer to read line by line and using string tokenizer to capture data.
use buffered IO reader here,
Logged
MOON JAVA
« Reply #1 on: March 22, 2011, 06:01:37 PM »

 Logged
Timmortegaa
Newbie
*

Karma: +0/-0
Posts: 1



View Profile WWW Email
« Reply #2 on: June 12, 2011, 07:03:07 AM »

Its amazing, loing at the time and effort you put into your blog and detailed information you provide.
Logged

MOON JAVA
« Reply #2 on: June 12, 2011, 07:03:07 AM »

 Logged
Pages: [1]
  Print  
 
Jump to: