Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parse: adding token start and end position in input string #17

Open
dimashi opened this issue Mar 25, 2020 · 0 comments
Open

Parse: adding token start and end position in input string #17

dimashi opened this issue Mar 25, 2020 · 0 comments

Comments

@dimashi
Copy link

dimashi commented Mar 25, 2020

I would like to remove some parts from the address string keeping original casing. For example I'd like to remove unit number from the address. I parse full address, get all lower cased parts, then I want to construct address without unit number. Since parsed output skips all the stop words (spaces, commas) it would help to add to each token start and end position in the original string so I can link token to exact postion in the string.
Another option is to return original input in original casing, and stop words.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant