Function tokenize_iter

pub(crate) fn tokenize_iter(
    input: &str,
    lo: BytePos,
) -> impl '_ + Iterator<Item = Result<SpannedToken>>

Yields spanned tokens from the given source code text.

The lo byte position determines where spans will start.