Trait Tokens

Source

pub trait Tokens<TokenAndSpan>: Clone + Iterator<Item = TokenAndSpan> {
    type Checkpoint;

Show 20 methods    // Required methods
    fn set_ctx(&mut self, ctx: Context);
    fn ctx(&self) -> Context;
    fn ctx_mut(&mut self) -> &mut Context;
    fn syntax(&self) -> SyntaxFlags;
    fn target(&self) -> EsVersion;
    fn checkpoint_save(&self) -> Self::Checkpoint;
    fn checkpoint_load(&mut self, checkpoint: Self::Checkpoint);
    fn set_expr_allowed(&mut self, allow: bool);
    fn set_next_regexp(&mut self, start: Option<BytePos>);
    fn token_context(&self) -> &TokenContexts;
    fn token_context_mut(&mut self) -> &mut TokenContexts;
    fn set_token_context(&mut self, c: TokenContexts);
    fn add_error(&mut self, error: Error);
    fn add_module_mode_error(&mut self, error: Error);
    fn end_pos(&self) -> BytePos;
    fn take_errors(&mut self) -> Vec<Error>;
    fn take_script_module_errors(&mut self) -> Vec<Error>;
    fn update_token_flags(&mut self, f: impl FnOnce(&mut TokenFlags));
    fn token_flags(&self) -> TokenFlags;

    // Provided method
    fn start_pos(&self) -> BytePos { ... }
}

Expand description

Clone should be cheap if you are parsing typescript because typescript syntax requires backtracking.

Required Associated Types§

Source

type Checkpoint

Required Methods§

Source

fn add_error(&mut self, error: Error)

Implementors should use Rc<RefCell<Vec>>.

It is required because parser should backtrack while parsing typescript code.

Source

fn add_module_mode_error(&mut self, error: Error)

Add an error which is valid syntax in script mode.

This errors should be dropped if it’s not a module.

Implementor should check for if Context.module, and buffer errors if module is false. Also, implementors should move errors to the error buffer on set_ctx if the parser mode become module mode.

Source