VOOZH about

URL: https://www.geeksforgeeks.org/python/python-nltk-nltk-tokenize-linetokenizer/

⇱ Python NLTK | nltk.tokenize.LineTokenizer - GeeksforGeeks


  • Courses
  • Tutorials
  • Interview Prep

Python NLTK | nltk.tokenize.LineTokenizer

Last Updated : 12 Jun, 2019
With the help of nltk.tokenize.LineTokenizer() method, we are able to extract the tokens from string of sentences in the form of single line by using tokenize.LineTokenizer() method.
Syntax : tokenize.LineTokenizer() Return : Return the tokens of line from stream of sentences.
Example #1 : In this example we can see that by using tokenize.LineTokenizer() method, we are able to extract the tokens from stream of sentences into small lines. Output :
['GeeksforGeeks...$$&* ', 'is', ' for geeks']
Example #2 :
Output :
['The price', '', ' of burger ', 'in BurgerKing is Rs.36.']
Comment
Article Tags:
Article Tags: