Tokenizing Floating point numbers.

From: dejavous_ie_at_[hidden]
Date: 2001-11-30 17:27:43

Hi all,
I am using the tokenizer to parse input files and I was wondering if anyone can tell me how to tokenize a floating point number. When I use the tokenizer it splits the number at the decimal point and I'm not sure how to prevent this. I would appreciate it very much if someone could tell me how to get around this problem.

Some sample input is {0 0.23 56 45.456}.
It tokenizes this to:
0
0
23
56
45
456

Thanks in advance for any help given.