Verilog: use flex tokenizer in the preprocessor

This commit contains the changes to the preprocessor to remove the existing
ad-hoc tokenizer, and replace it by the flex-based tokenizer.

Author: kroening