Euphoria Ticket #507: Make euphoria/syncolor.e depend on euphoria/tokenizer.e

Right now, we have 3 parsers in the front end. The internal euphoria scanner/parser/tokenizer is too specific and speed optimized to make for a merge of it and tokenize.e

However, we can and should make syncolor.e use tokenize.e to parse the files before colorizing them. Alternatively, add optional support to tokenize.e to do colorizing and get rid of syncolor.e

Details

Type: Bug Report Severity: Minor Category: Library Routine
Assigned To: jimcbrown Status: Fixed Reported Release:
Fixed in SVN #: 4622 View VCS: 4622 Milestone: 4.1.0

1. Comment by jeremy Dec 06, 2010

This will take some major? changes to tokenize. In order to provide just syntax coloring, we will have to being to track all whitespace in tokenize.e. It would become another option, keep_space(). Then presumably return T_SPACE with the token data as whatever spacing exists between tokens, such as " \t"

2. Comment by jimcbrown Dec 08, 2010

This is fixed in the coverage branch. We just need to move it over once 4.0.0 final is done, and we can call this fixed.

3. Comment by mattlewis Mar 01, 2013

I'm marking this as fixed. Whether it's done in 4.0, it's done in 4.1, so...good enough.

Search



Quick Links

User menu

Not signed in.

Misc Menu