Reading a token

[Remedy]

Hello,
I try to read a sentence like it was a word. Let me explain I suppose that such a file directory:

TT 10Street cat 00000232
...
...

The first word is the name, the last telephone number, but that there's entry represents the customer address. However when I use the method nextToken () of StringTokeniser Obviously he will cut me my chain style.

Token1: TT
Token2: 10,
Token3: Street
Token4: the
Token5: cat
Token6: 00000232

How can I read the tokens properly, so that I can get the desired output.

[opaper]

Hello,
I have a code, please go through the code, I think this will help you.
package test;

Public class TokenReader {
private String[] dic;
private static Final DictionnaryPattern Pattern = Pattern.compiles("([A-Z] +)\\s +(.+?)\\s + ([0-9] +) ");
Public TokenReader(String[] d) {
dic = d;
}

Public void analyze() {
for (String line: dic) {
Matcher m = dicPattern.matcher(line);
System.out.System.out.println("Analyzing line:" + Line);
if (m.games()) {
System.out.System.out.println("Type" + M.group(1));
System.out.System.out.println("Address" + M.group(2));
System.out.System.out.println("Tel:" + M.group(3));
}
}
}
Public static void hand(String[] args) {
String[] directory = new String[] {
"TOTO 10, rue du dog 0000023224"
,"TITI 40, boulevard de la victory 3211588522"
};

TokenReader r = new TokenReader(Directory);
stanalyze();
}
}

[Remedy]

Hello,
But I wanted to know if there is no way to do it with StringTokenizer? Because in my file I have lots of different type of string that I deal with StringTokenizer and nextToken (), there are those types of book that I have a problem. So I did not do a mix between StringTokenizer and the method proposed above. Is there any other way to do this? If any then please do help me.

[kelfro]

Hello,
Take a look at the following code

public class TokenizingJavaSourceCode{

    public static void main(String[] args) throws IOException{
    BufferedReader in = new BufferedReader(new InputStreamReader(System.in));
    System.out.print("Please enter a java fl name: ");
    String flnm = in.readLine();
    if(!flnm.endsWith(".java")){
      System.out.println("This is not a java fl.");
      System.exit(0);
    }
    File javaFile = new File(flnm);
    if(javaFile.exists()){
      FileReader fl = new FileReader(flnm);
      StreamTokenizer streamTokenizer = new StreamTokenizer(fl);
      // It will go through the fl and gives the number of tokens in the fl
      int i=0;
      int nutkgen = 0;
      while(i != StreamTokenizer.TT_EOF){
        i = streamTokenizer.nextToken();
        nutkgen++;
      }
      System.out.println("Number of tokens = " + nutkgen);
    }
    else{
      System.out.println("File does not exist!");
      System.exit(0);
    }
  }

[Zecho]

Hello,
You can split first and last element, here it is, how you can do it.

String [] table = lntest.split(" ");
String first = table[0];
String last = table[board.length-1];

Try splitting the elements and then see if the code works properly, if not then post the error what you get.

[Praetor]

Hi,
Here is another example of how you can use the splitting.

StringTokenizer strtok = new StringTokenizer(dbRecord, ":");

String fname = strtok.nextToken();
String lname = strtok.nextToken();
String city  = strtok.nextToken();
String state = strtok.nextToken();

println("First:  " + fname);
println("Last:   " + lname);
println("City:        " + city);
println("State:       " + state);

Hope this will help you. Best of Luck.